AD-A102  341  WASHINGTON  UNIV  SEATTLE  DEPT  OF  ELECTRICAL  ENGINEERING  F/G  12/1 

MODELING  ANO  PERFORMANCE  OPTIMIZATION  OF  LARGE-SCALE  OATA-COMMU— Etc (U) 
JUN  81  F  G  G0RECK1  AF0SR-78-3546 


UNCLASSIFIED  UW-EE-TR-221 


AFOSR-TR— 81-0602 


0Ht  RL£  COPV  ADA102341 


Department  of  Electrical  Engineering 
College  of  Engineering 
University  of  Washington 
Seattle,  Washington  98195 


DtlC 

Seuec  \ 

j 


81  8  0  3  07  3 


Approved  for  public  release  • 
distribution  linliisited. 


rnmmumam 


'  >  L. 

/  / 

i  ' 


^DELING  AND  ^PERFORMANCE  OPTIMIZATION  OF 
LARGE-SCALE  _DATA-COMMUN I CAT ION ^NETWORKS 0 

ty 

/$)  Francis  D.^Gorecki  y1 

E.  E.  Dept.  Technical  Report  No.  221 

?{  I  r  , ./ 


This  report  is  based  on  the  dissertation  of  Francis  D.  Gorecki 
which  was  completed  in  partial  fulfillment  of  the  requirements 
for  the  degree  of  Doctoq.  of  Philosophy  at  the  University  of 

Washington,  Seattle,  Washington  in  June  1981.  The  research  ^ 

reported  herein  was  supported  in  part  by  the  U.  S.  Air  Force  ^  ' $ ZD 

Office  of  Scientific  Research  under  Grant  No.^HMH^and 

in  part  by  the  National  Science  Foundation  under  NSF  Grant  No. 

ECS-8OH262.  Any  opinions,  findings,  and  conditions  r-  recommenda¬ 
tions  expressed  in  this  publication  are  those  of  tb  author  and 
do  not  necessarily  reflect  the  views  of  the  above  agencies. 


ft)  /ffO-R  it  1  w-sE-m-i  11 


11 )  rz 


A* 


June  1981 


Department  of  Electrical  Engineering 
University  of  Washington 
Seattle,  Washington  98195 

AIR  FORCE  OFFICE  OF  SCIENTIFIC  RESEARCH  (AFSC) 
NOTICE  OF  TRANSMITTAL  TO  DDC 

This  technical  report  has  hven  reviewed  and  is 
approved  for  pub! :  release  LAW  APR  190-12  (7b). 
Distribution  is  11.1!  ;j  itcd. 

A.  D.  BLOiiE 

Technloai  Information  Officer 


V? 


University  of  Washington 


Abstract 

Modeling  and  Performance  Optimization  of  Large-Scale 
Data-Communication  Networks 
By  Francis  D.  Gorecki 


Chairperson  of  the  Supervisory  Committee:  James  S.  Meditch 

,  >v.a  frofe^sor  .and  Chairman 
Department  of  Electrical 
Engineering 


A  new  theory  of  modeling,  analysis,  and  performance 
optimization  is  developed  and  illustrated  for  large-scale,  data- 
communication  networks.  In  a  novel  and  significant  departure  from 
existing  problem  formulations,  channel  and  network  models  are 
presented  which  include  the  effects  of  channel  distortion,  nodal 
processing  errors,  and  protocol  dependent  errors.  All  of  these 
effects  are  of  critical  importance  in  practice,  but  cannot  be 
readily  incorporated  into  other  models.  Information  theoretic 
techniques  are  developed,  and  used  to  characterize  network  capacity 
and  message  integrity  as  a  function  of  protocols,  routing  policies. 


channel  capacity  assignment,  and  channel  distortion.  Flow 
assignment  techniques  which  optimize  network  performance  with 
respect  to  certain  classes  of  physically  important  performance 
metrics  are  formulated  and  employed  to  derive  new  centralized  and 


distributed  routing  algorithms. 
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Chapter  1 


INTRODUCTION 


1.1  Background 

In  the  last  decade,  large-scale,  data-communi cation  networks 
have  both  expanded  across  continents  into  globally-distributed 
systems  interconnecting  major  computer  facilities,  and  contracted 
into  office  complexes,  interconnecting  laboratories  and  offices  and 
their  associated  instruments  and  minicomputers.  Examples  of  the 
globally-distributed  networks  are:  ARPANET,  a  U.S.  Department  of 
Defense  computer  network  [ 1 ] ;  TYMNET,  a  specialized  U.S.  based 
common  carrier  network  with  links  to  Europe  [2];  and  TRANSPAC,  the 
French  electronic  mail  system  [3].  An  example  of  a  local-area 
network  is  ETHERNET,  a  system  for  carrying  digital  data  packets 
among  locally  distributed  minicomputers  [!»]• 

The  basic  purpose  of  large-scale  computer-communication 
networks  is  to  share  computing  resources  among  geographically 
distributed  users.  The  resources  may  be  databases,  computer  power, 
specialized  hardware,  or  specialized  software.  (The  phrases  data- 
communication  and  computer-communication  are  considered  synonymous 
for  the  purposes  of  this  research  and  are  used  interchangeably 
throughout  the  text.)  The  large-scale  network  may  be  viewed  as  a 
collection  of  nodes  and  links  which  may  be  divided  into  a  communi¬ 
cations  subnetwork  and  a  user-resource  subnetwork  as  shown  in 
Figure  1.1  [5].  The  communication  subnetwork  provides  message 
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formatting,  routing,  flow  control,  and  data  integrity  procedures  for 
the  user-resource  subnetwork.  Typically,  the  switching  computers  of 
the  communications  subnetwork  are  tied  to  a  backbone  of  high-speed, 
point-to-point  terrestrial  links.  All  entry  and  exit  for  the  network 
passes  through  the  switching  computers.  The  users  at  their  terminals 
access  distributed  computing  resources  via  the  communications  subnet¬ 
work.  The  switching  computers  of  the  communications  subnetwork 
establish  the  necessary  interconnections  to  link  user  and  resource, 
or  source  and  destination.  The  communication  networks  can  be  cate¬ 
gorized  by  the  type  of  linkage  employed:  circuit-switched;  message- 
switched;  and  packet-switched.  The  circuit-switched  networks 
establish  dedicated  paths  for  a  given  user-resource  pair.  The  path 
is  allocated  for  the  duration  of  a  user-resource  session.  (A 
different  path  may  be  used  on  a  succeeding  user- resource  session, 
but  it  will  be  dedicated  for  the  duration  of  the  session.)  This  is 
the  familiar  mechanism  used  in  telephone  systems.  Message-switched 
and  packet-switched  sytems,  on  the  other  hand,  do  not  establish 
dedicated  channels  for  simultaneous  use  by  the  user- resource  pair. 

In  message-switched  systems,  the  message  moves  from  a  user  (or 
source)  node  to  the  next  node  on  a  path  selected  according  to  a 
routing  algorithm.  The  message  is  moved  through  the  network  in  this 
store-and-forward  fashion  until  it  reaches  the  resource  (or  desti¬ 
nation)  node.  A  packet-switched  system  is  similar  in  its  use  of  the 
store-and-forward  technique.  A  message  from  a  user  (or  source  node) 
is  divided  into  smaller  units  or  packets.  The  packets  move  through 
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the  communications  subnetwork  in  a  store-and-forvard  manner  until 
they  reach  their  destination.  At  the  destination  the  message  is 
reconstructed  from  the  packets.  Because  each  user  or  resource  is 
not  directly  connected  to  all  others,  messages  and  packets  pass 
through  several  links  and  switching  computers  before  reaching  their 
destination.  (In  general,  the  terms  packet  and  message  may  be  used 
interchangeably.  If  there  is  a  restriction  to  packet  or  message 
format  in  the  research,  then  that  will  be  noted  in  the  pertinent 
text  material.)  The  rules  for  making  the  link  connections,  choosing 
the  paths,  and  controlling  the  network  traffic  involve  the  use  of 
computer- communication  protocols  and  routing  strategies  [6,7].  The 
strategies  employed  may  be  chosen  to  optimize  particular  network 
performance  measures.  Network  performance  measures  include  message 
volume,  link  or  channel  utilization,  average  message  delay,  message 
or  data  integrity,  and  processor  or  buffer  utilization.  For  example, 
the  message  arrival  characteristics  in  a  computer  environment  are 
bursty,  hence  the  packet-switched  approach  provides  a  low-cost 
network  solution  by  minimizing  the  number  of  channels  required  to 
connect  a  large  number  of  users  to  geographically  distributed 
computer  facilities  and  to  each  other.  Another  tangible  advantage 
of  packet-switched  networks  is  their  ability  to  accommodate  a  broad 
spectrum  of  data  rates.  In  a  circuit-switched  network,  the  communi¬ 
cating  devices  fall  into  mutually  exclusive  data  rate  categories. 
Packet-switching  accommodates  these  diverse  data  rates  through  the 
communication  subnetwork /user- re source  subnetwork  interface. 


Theoretical  studies  have  been  directed  to  the  network  flow 


problems  and  the  problems  of  delay  analysis,  routing  assignment, 
topological  design,  and  protocol  impact  [8,9].  Open  problems  still 
exist  in  determining  optimum  message  routing  strategies  and  the 
effects  of  channel  distortion  and  nodal  processing  or  protocol- 
dependent  errors  on  network  performance.  The  problem  of  optimum 
message  routing  is  complicated  because  the  network  is  a  system  of 
interacting  queues  and  because  of  the  large  number  of  network 
variables  involved.  Similarly,  the  effects  of  channel  distortion 
and  nodal  processing  or  protocol-dependent  errors  have  resisted 
analysis  because  of  an  absence  of  a  theoretical  framework  in  which 
to  operate  and  because  of  the  overwhelming  number  of  variables 
involved  in  analyzing  a  large-scale  data-communi cation  network. 

1.2  The  Problem  of  Data  Integrity 
and  Flow  Assignment 

Due  to  the  complexity  of  the  theoretical  formulation, 
previous  investigations  have  ignored  the  problem  of  message 
corruption  both  in  the  network  performance  analysis  and  the  estab¬ 
lishment  of  suitable  routing  doctrines  [5,8].  The  canonical  network 
models  have  assumed  distortionless  communication  of  messages. 
Derivative  performance  analyses  and  routing  algorithms  are,  there¬ 
fore,  best  case  results.  In  practice,  of  course,  message  distortion 
is  encountered  [10].  The  existence  of  'real  world'  sources  of 
error  have  led  system  designers  to  use  various  techniques,  such  as 
computer- communications  protocols  with  error  correct/detect 
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features,  to  maintain  message  integrity.  This  sort  of  practical 
solution  to  the  message  corruption  problem  exacts  a  system 
performance  penalty,  viz.,  message  delay  is  increased  due  to  the 
implementation  of  the  requisite  protocols.  While  protocol  models 
do  exist,  they  are  too  complex  to  be  useful  in  modeling  large-scale 
networks  [ll],  and  are  limited  to  single  channel  behavior. 

Thus,  what  is  required  for  successful  network  modeling  is  a 
general  methodology  for  analyzing  the  broad  class  of  network 
problems  relating  to  data  integrity  and  its  relationship  to  system 
performance  in  large-scale  networks.  The  results  of  this  general 
approach  should  then  drive  the  routing  assignment  doctrine.  (By  the 
way  of  a  parenthetical  comment,  it  should  be  noted  that: 

1.  Successful  operation  of  a  data  communication 
network  is  critically  dependent  on  the  provision  of 
an  adequate  routing  algorithm. 

2.  The  choice  of  routing  algorithm  strongly  influences 
network  performance. 

3.  Many  Ph.D.  dissertations  have  been  devoted 
exclusively  to  development  of  a  specific  routing 
policy.  (Few  of  these  techniques  have  been 
implemented. ) 

This  research  has  developed  the  needed  general  approach  to 
message  corruption  in  computer-communication  networks  and  linked 
that  approach  to  relevant  routing  strategies.  The  general  approach 
combines  both  information-theoretic  and  queueing-theoretic 
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techniques.  The  resulting  routing  strategies  include  both 
centralized  and  distributed  policies. 

1.3  Outline  of  Dissertation 

In  the  remainder  of  Chapter  1,  the  basic  problem 
formulation  for  network  modeling  is  presented  along  with  the 
stochastic  'network  of  queues'  model.  Chapter  2  develops  the  basic 
information-theoretic  concepts  and  their  extensions  for  data- 
communication  network  modeling,  viz.,  the  theory  of  rate  distortion 
functions  suitably  enhanced  and  strengthened  for  multiple  user 
network  theory.  Chapter  3  develops  relevant  routing  strategies 
which  optimize  network  performance  with  respect  to  certain  classes 
of  physically  important  performance  metrics.  Both  centralized  and 
decentralized  algorithms  are  presented.  Additionally,  in  Chapter  3, 
network  examples  in  which  the  most  significant  of  the  routing 
algorithms  have  been  used  for  flow  assignment  are  presented.  In 
Chapter  4,  computational  results  derived  from  the  application  of  the 
theory  developed  in  Chapter  2  are  presented  as  well  as  a  network 
example  which  illustrates  the  results  of  the  preceding  chapters. 
Finally,  conclusions  and  directions  for  future  research  are 
presented  in  Chapter  5. 

1.4  Network  Modeling 

The  purpose  of  this  section  is  to  provide  a  brief  review 
of  the  principle  modeling  methodologies  for  large-scale,  data- 
communication  networks.  Stochastic  analysis,  especially  queueing 
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theory,  has  been  used  to  derive  the  bulk  of  the  theoretical  results 
in  the  analysis  and  synthesis  of  computer-communication  networks. 

The  first  models  are  due  to  Kleinrock  and  were  formulated  in  the 
early  60's  [12].  The  queueing-theoretic  approach  has  had  a  great 
deal  of  success  in  modeling  networks  although  it  does  not  deal  with 
a  number  of  difficult  problems  such  as  channel  noise,  finite  nodal 
storage,  dynamic  routing  and  stability,  and  flow  control  procedures. 
The  basis  for  the  model  is  the  single  server  queueing  system  with 
exponentially  distributed  Job  service  and  interarrival  times.  This 
simple  case  is  abbreviated  as  an  M/M/1  system  where  the  M/M  stands 
for  Markovian  distribution  of  job  interarrival  and  service 
statistics  and  /I  denotes  a  single  server.  (Other  Job  statistics 
have  been  studied  e.g.  G/G/l,  general  distributions  of  both  job 
service  and  Job  interarrival  times.  The  general  theory  is  quite 
complex  and  has  not  been  successfully  applied  to  networks  [ 1 3 ] . ) 

1.1*.  1  M/M/1  Queueing  Models 

Consider  the  server  queue  system  shown  in  Figure  1.2. 
Customers  arrive  to  the  system  with  an  average  rate  of  A  customers 
sec.  The  customers  wait  in  the  queue  until  they  are  serviced.  The 
average  service  time  is  1/y  sec.  While  waiting  in  the  queue  the 
customers  are  serviced  on  a  first-come-first-served  (FCFS)  basis. 

In  the  steady  state,  the  customers  depart  the  system  with  an 
average  rate  A.  To  make  the  discussion  more  precise,  let  A(t)  and 
B ( x )  be  the  probability  distribution  functions  of  the  interarrival 
and  service  processes,  respectively.  Then  for  M/M  systems. 


queue 


server 


arriving 
customers 

Figure  1.2  Model  for  M/M/1  queueing  system 
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A(t)  =  1  -  e"U,  t  >  0  (1.1) 

and 

B(x)  =  1  -  e"yx,  x  >  0  (1.2) 

Denoting  £(•]  as  the  expectation  operator, 

E[ t ]  =  1/A  (1.3) 

and 

E[x]  =  1/w  (l.U) 

As  noted  previously,  A  represents  the  average  arrival  rate  and  1/p 
the  average  service  time  for  the  customers. 

Equation  (l.l)  is,  of  course,  the  interarrival  distribution 
for  a  Poisson  counting  process  [ ll»  ] .  The  probability  of  k  arrivals 
in  an  interval  (T,T+t)  for  a  Poisson  process  is 

Pr[k  arrivals  in  t]  =  (At)1*  _e_  Xt  (1.5) 

k! 

The  differential-difference  equations  corresponding  to  the  M/M/1 
system  are  easily  shown  to  be  [13,  p.  7b], 
dP  (t) 

-Tt - U  *  "IPk(t)  *  1PK-l(t)  *  “Vi(t)  U-6) 

for  k  >  1,  and 

dP  (t) 

—  =  -AP  (t)  +  pP.(t)  (1.7) 

dt  o  l 

for  k  *  0,  where 

Pr(No.  of  customers  in  system  at  time  t 

i s  equal  to  k ]  =  P^ ( t )  (1.8) 
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This  set  of  coupled  equations  may  be  solved  by  first  taking  the 
z-transform  and  then  the  Laplace  transform  of  Eq.  (1.6)  and 
Eq.  (1.7).  The  general  solution  is  obtained  by  inverting  the 
combined  Laplace  and  z-transform  transfer  function.  The  solution 
is  an  infinite  series  of  modified  Bessel  functions  of  the  first 
kind  of  integer  order.  Understandably,  the  complete  general 
solution  is  too  unwieldy  for  network  modeling  applications. 

Fortunately,  the  probabilities  PjJt)  have  steady  state 
limiting  values.  Defining 


p.  «  lim 
t-*» 


Pk(t) 


(1.9) 


and  setting  the  left-hand  terms  of  Eq.  (1.6)  and  Eq.  (1.7)  to  zero 
leads  to  the  steady  state  solution  for  the  system. 


where  k  >  0. 
is  simply 


(1.10) 


‘k  ro'y’ 

The  necessary  and  sufficient  condition  for  ergodicity 


X  <  v 

Applying  the  conservation  of  probability 


(1.11) 


l  Pk  •  1  (1.12) 

k=0  K 


leads  to 


P 


o 


(1.13) 


Defining  the  system  utilization  as 


P  ■  A/w 


(1.1U) 


allows  the  equilibrium  solution  to  be  expressed  as 


Pk  =  (1  -  p)  pk  (1.15) 

Certain  important  system  parameters  may  be  quantified  after  the 
introduction  of  Little’s  result.  Little's  result  may  be  stated  as: 
at  equilibrium,  the  average  number  of  customers  in  a  queueing  system 
is  equal  to  the  average  arrival  rate  of  customers  to  that  system, 
times  the  average  time  spent  in  the  system  tl5l.  Denoting  the 
average  time  in  the  system  as  T  and  the  average  number  of  customers 
in  the  system  as  N,  Little's  result  may  be  written  as 

R  =  XT  (1.16) 

From  Eq.  (1.15),  the  average  number  in  the  system  is  easily  shown 
to  be 

N  -  l  kp  *  i-e—  (1.17) 

k=0  K  1  P 

The  average  time  in  the  system  can  then  be  found  using  Eq.  (1.16) 
and  Eq.  ( 1 . IT )  as 

T-f-— i-r  (1.18) 

X  u  -  X 

The  average  delay  as  expressed  in  Eq.  (1.18)  is  a  key  result  which 
will  be  used  repeatedly  in  this  research. 

1.U.2  Network  of  Queues  Model 

The  M/M/1  system  described  in  the  previous  paragraph  can  be 
considered  as  a  single  node  system,  One  can  also  imagine  multiple 
node  systems  in  which  a  customer  queues  and  receives  service 
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C 
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successively  at  several  nodes.  If  the  messages  or  packets  of  the 
previously  described  store-and- forward  networks  are  considered  as 
customers,  and  the  switching  computers  and  communication  channels 
are  viewed  as  FCFS  queues  with  associated  servers,  then  the  queueing 
model  for  a  store-and- forward  network  is  a  multistage  tandem 
queue  [ 8 ] . 

The  simplest  example  of  a  tandem  queue  is  the  system  of  two 
servers  shown  in  Figure  1.3,  which  was  originally  studied  by 
R.  R.  P.  Jackson  in  the  1950's  [16].  The  system  consists  of  the 
first  node,  an  M/M/l  queue  with  service-rate  p  ,  feeding  a  second 
queueing  system  with  service  rate  p^.  Defining  the  stationary  joint 
probability  state  vector  of  the  system  as  p(ki,k?)  where 
Prfk.^  elastomers  in  first  system  and  k 2  customers 

in  the  second  system]  =  pCk^kg)  (1.19) 

Jackson  showed  the  joint  probability  was  simply  the  product  of  the 
state  probabilities  for  two  independent  M/M/l  queues,  i.e., 

k  K. 

pCk^kg)  a  p^k^p^kg)  *  ^  ”  V°1  1^1  -  P2^p2  2  ( 1  • 20 ) 

In  1956,  P.  J.  Burke  and  E.  Reich  proved  that  the  output  of 
an  M/M/l  system  was  also  Poisson  [17].  These  two  results  then  lead 
to  the  conclusion  that  the  Joint  probability  state  vector  for  any 
feedforward  queueing  system  is  equal  to  the  product  of  the  marginal 
distributions,  namely, 

N 

p(k^,kg, — kN)  «  H  pi(ki) 


(1.21) 


Figure  1.3  The  two-node  tandem  net;  (a)  Details 

of  the  two-node  tandem  net;  (b)  Network 
representation 
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Equation  (l.2l)  is  also  valid  for  systems  with  m  servers  at  each 

node,  i.e.,  M/M/m  systems  [l8],  The  feedforward  systems  are  special 

cases  of  feedback  networks.  (In  a  feedback  hetwork  customers  are 

allowed  to  return  to  previously  visited  nodes.)  J.  R.  Jackson 

studied  feedback  networks  in  which  external  arrivals  and  departures 

were  permitted  [l8 ] .  The  model  considered  consists  of  N  nodes,  the 

ith  node  contains  m.  servers  each  with  service  rate  l/p..  Poisson 
i  1 

arrivals  are  allowed  to  enter  the  ith  node  from  outside  the  network 
with  rate  y, .  After  receiving  service  at  the  ith  node  a  customer 
goes  to  node  j  with  probability  r^ .  The  total  arrival  rate  to  the 
ith  node  can  then  be  written  as 


xi *  Ti  *  jiVji 


(1.22) 


Jackson's  result  for  the  joint  equilibrium  probability  distribution 
for  the  network  is 


N 

p(k1,...kN)  =  IT  pi(k.)  (1.23) 

i=l 

These  results  can  be  extended  to  closed  Markovian  queueing  networks 
in  which  a  fixed  population  of  customers  circulate  within  the 
network.  Again,  the  results  are  product  form  solutions  [ 19,20]. 

The  foregoing  results  would  be  directly  applicable  to  the 
store-and- forward  data  communications  network  except  that  in 
such  network  there  is  dependence  among  the  interarrival  times  and 
the  service  times.  The  dependence  can  be  seen  by  considering  the 
two-node  system  of  Figure  1.3.  The  interarrival  time  between  two 
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successive  messages  (or  packets)  entering  node  2  can  never  be  less 
than  the  service  time  for  the  first  of  those  messages  [5,  p.  321]. 
Therefore  the  arrival  distribution  to  the  second  node  is  not  Poisson 
and  the  results  of  Jackson,  Newell,  et  al.  do  not  apply.  To 
circumvent  this  difficulty,  Kleinrock  invoked  the  Independence 
Assumption,  to  wit:  Each  time  a  message  (packet)  is  received  at  a 
node  within  a  network,  a  new  length  is  chosen  independently  from 
the  probability  density  p(x)  =  pe  UX.  In  effect,  each 
queue  in  a  packet  network  is  assumed  to  be  an  independent  M/M/1 
system  with  an  arrival  rate  of  X^.  This  assumption  has  given  good 
agreement  between  theory  and  practice  in  networks  of  moderate 
connectivity  and  forms  the  basis  of  the  research  developed  here. 

1.U.3  Delay  Analysis 

Perhaps  the  single  most  important  network  performance 
measure  is  message  delay,  either  average  for  all  messages  or 
end-to-end  for  a  specified  user-resource  (source-destination)  pair. 
The  purpose  of  this  section  is  to  calculate  appropriate  expressions 
for  both  the  average  message  c-.-lay  T,  and  the  end-to-end  delay  T 

8.0 

where  a  represents  a  source  node  and  b  represents  a  destination 
node. 

Consider  a  N-node  network  with  M  directed  links.  The  paths 

taken  by  messages  originating  at  node  J  and  destined  for  node  k  is 

denoted  by  it,  .  The  ith  link  with  capacity  C.  is  in  the  path  ir 

J  *  1  J  K 

if  messages  from  J  to  k  ((J,k)  traffic)  utilize  that  link.  The 
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traffic  requirements  for  the  network  are  denoted  by  an  average  of 

{ Y  v }  messages/sec.  where  J  is  a  source  node  and  k  is  a  destination 
JK 

node 

The  average  flow  in  the  ith  channel  is  related  to  the 
message  flow  rates  of  all  paths  which  include  the  ith  channel 


\*lly 

J  k  Jk 


(1.2U) 


Jk: 


Defining  Z  as  the  average  message  delay  for  a  message  originating 
JK 

at  j  destined  for  k,  then  the  average  for  all  messages  can  be 
expressed  as 


N  N  y 

T«  l  l  Z 

J-l  k»l  1 


JK 


(1.25) 


where 


N  N 

y  =  l  l 

j=l  k=l  J 


(i.26: 


Denoting  as  the  average  delay  encountered  in  waiting  for  and 


using  the  ith  channel  it  is  possible  to  express  Z  as 

JK 

1  Jk 

Combining  Equations  (1.25)  and  (1.27)  yields 


(1.27) 


N  N  y  . 

t  -  l  l  It. 

j=ik=i  *  i:C.^k 


(1.28) 


Interchanging  summations  and  observing  the  conditions  on  the  (j,k) 
pairs  and  using  Eq.  (1.2^)  gives  the  desired  result  for  T[5,  p.  321], 
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M  X 


**  ^  . 

=  l  —  T 
i=l  Y  1 


(1.29) 


Using  the  results  of  section  1.4.2,  the  ith  channel  is  now 


represented  as  an  M/M/1  system  with  Poisson  arrivals  at  rate  A^  and 
exponential  service  times  of  mean  1/pC^. 

The  solution  for  T^  is  then  given  by  Eq.  (l.l8) 

1 


T  = 
i  pC.  -  X. 

l  l 


(1.30) 


Substitution  of  Eq.  (1.30)  into  Eq.  (1.29)  produces  a  simple  form 
for  tr:t  average  message  delay 

M  A 

T  *  I  -7  (pc-ri'1  (1-31) 

i*l  '  Ai 

The  appropriate  expression  for  the  average  end-to-end  delay 
may  be  stated  after  defining  the  path  indexed  message  routing 
variables  (r^(j,k)}  and  the  path  and  link  indexed  routing  variables 
(rj[(J«k))>  following  the  approach  of  [21].  The  path  indexed  routing 
variable  r^J.k)  is  defined  as  being  the  fraction  of  (j,k)  traffic 
which  is  routed  on  the  4th  shortest  (j,k)  path.  The  set  of  links 
comprising  the  4th  shortest  (j,k)  path  is  denoted  by  The  path 

indexed  message  routing  variable  r^(,J,k)  will  have  the  same  value 

l 

in  all  the  links  in  the  set  x  ,  and,  in  general,  is  the  quantity  of 

Jk 

interest.  Occasionally,  however,  it  is  necessary  to  denote  the 

message  routing  variable  for  the  4th  shortest  (j,k)  path  and  for 

l 

a  specific  link  in  the  set  w,.  .  To  accommodate  this  requirement, 

J  K 

the  path  and  link  indexed  routing  variable  r*(j,k)  is  introduced. 
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The  notation  r*(j,k)  denotes  the  fraction  of  (j,k)  traffic  on  the 

ith  shortest  (j,k)  path  traversing  link  i.  For  example,  assume  the 

fourth  shortest  (j,k)  path  was  made  up  of  links  9*  10,  and  16. 

Then  the  path  indexed  message  routing  variable  is  denoted  as 

*\(j,k).  The  path  and  link  indexed  message  routing  variables  are 

denoted  by  r^(j,k),  r^°(j,k),  and  rj^(j.k).  Of  course,  the 

numerical  values  of  r^J.k),  r^(j,k),  r^°(j,k),  and  r^(j,k)  are 

equal.  The  set  of  all  links  involved  in  carrying  traffic  from 

node  j  to  node  k  [(  J,k)  traffic]  is  denoted  by  it  . 

Jk 

Non-negativity  of  flow  and  conservation  of  flow  require 

that 


r£(j,k)  >  0 

(1.32) 

I  rt(j,k)  =  1 

(1-33) 

l 


for  all  J  ,k  in  Eq.  (1.32)  and  for  each  (j,k)  pair  (each  (j,k) 
pair  is  a  commodity)  in  Eq.  (1.33).  Similarly,  for  the  path  and 
link  indexed  message  routing  variables  {r*(j,k)},  non-negativity  of 
flow  requires  that 

rJ(j,k)>0  (1.31*) 

for  all  i,  i,  J,  k  in  Eq.  (1.3**). 

Note  that 

TjU.ls)  *  r£(j,k) 

£ 

for  all  ieit..  and  for  each  (j,k)  pair  in  Eq.  (1.35). 


% 


(1.35) 
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Using  the  above  definitions,  the  end-to-end  average  message 
delay  for  the  (a,b)  source-destination  node  pair  may  be  expressed 
in  two  ways.  First,  using  the  path  indexed  message  routing 
variables  the  end-to-end  delay  is  expressed  as 


r.(a,b) 

r  — z -  =  t 

.  yC.  -  ab 

leir  .  1  i 

ab 

0 

£eir 


(1.36) 


ab 

Second,  using  the  path  and  link  indexed  message  routing  variables 
the  end-to-end  delay  is  expressed  as 


r  { a,b) 

0 


(1.37) 


ab 

In  Eq.  (1.36)  and  Eq.  (1.37)  the  summation  is  over  the  individual 
l 

paths  11  and  the  set  of  all  paths  h  The  routing  variables 

depend  upon  the  routing  assignment  and,  as  shown  in  Chapter  3,  are 

the  quantities  which  are  optimized  for  certain  performance  metrics. 

(Note  that  the  shortest  (j,k)  route  is  given  by  ,  the  second 

JK 

2 

shortest  route  by  ir  ,  and  so  on.) 

Finally,  the  message  routing  variables  may  be  used  in 
reformulating  Eq.  (1.2**)  for  the  flow  on  the  ith  channel  as 

xi  *  *  ri(j*k)Yjk 

J 


(1.38) 
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where  the  summation  is  over  all  the  commodities  which  flow  in  link  i 
and  r*(j,k)  is  the  appropriate  routing  variable  for  the  (j,k) 
traffic. 

1.5  Conclusions 

The  results  of  Section  l.U  pertain  to  the  class  of  network 
models  for  which  product  form  solutions  are  obtained.  The  basic 
assumptions  under  which  these  paradigmatic  solutions  are  valid  are: 

1.  Noiseless  channels. 

2.  Infinitesimal  nodal  processing  and  propagation  delay. 

3.  Equilibrium  conditions. 

U.  Infinite  nodal  storage  capacity. 

5.  State-independent  routing  procedures . 

6.  Absence  of  protocol-dependent  errors. 

7.  Independence  of  interarrival  and  service  time 
distributions . 

The  queueing-theoretic  formulation  presented  in  this  chapter  forms 


the  foundation  for  the  research  contained  in  the  remaining  chapters. 
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Chapter  2 


NETWORK  LEVEL  RATE  DISTORTION  THEORY 

2.1  Introduction  to  Chapter  2 

Rate  distortion  theory  has  been  used  in  the  past  to  describe 
the  performance  of  communication  channels  in  which  source  encoding 
is  followed  by  data  compression  and  then  channel  transmission  [1,2]. 
The  classical  work  in  rate  distortion  theory  has  shown  that  for  a 
wide  class  of  distortion  measures  and  information  sources,  there 
exists  a  rate  distortion  function  R(D).  The  importance  of  R(D)  is 
that  it  yields  a  lower  bound  on  the  average  message  distortion,  or 
a  lower  bound  on  the  required  channel  capacity.  In  practice,  the 
theory  has  not  had  much  impact .  The  lack  of  impact  may  be  due  to 
the  difficulty  in  modeling  sources  or  to  an  operational  aversion  to 
data  compression  schemes  [3].  Research  in  rate  distortion  theory 
has  centered  on  calculating  R(D)  for  specific  sources  and  distortion 
measures,  for  example  [U,5].  The  objective  of  this  chapter  is  to 
extend  single-channel  rate  distortion  theory  to  computer- 
communication  networks.  As  a  result  of  this  extension,  a  rate 
distortion  theory  for  modeling  communication  errors  in  networks  and 
for  evaluating  performance  degradation  due  to  channel  noise  will  be 
constructed. 

The  motivation  for  this  research  stems  from  noting  that 

single  channel  communications  suffer  from  bit  error  rates  (BER) 

-3  -12 

ranging  from  10  to  10  errors/bit.  The  high  rate  may  be  obtained 
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on  standard  telephone  lines  operated  without  error  correction,  the 
low  rate  through  the  use  of  conditioned  lines,  message  coding,  and 
error  detecting/error  correcting  protocols  [6,7,8].  In  general, 
the  penalties  for  the  low  bit  error  rate  are  found  in  the  additional 
costs  for  hardware  and/or  software  to  implement  the  message  coding, 
and  in  increased  channel  time  delays.  In  computer-communication 
networks,  the  penalty  for  reliable  communications  is  paid  by  addi¬ 
tional  costs  for  nodal  processing,  line  conditioning,  and  excessive 
message  delay  suffered  by  the  users.  These  penalties  suggest  that, 
although  error-free  messages  are  aesthetically  pleasing,  there  are 
classes  of  network  users  who  neither  require  high  message  fidelity 
nor  are  willing  to  pay  for  it.  As  an  example,  one  can  imagine  a 
national  electronic  mail  service,  in  which  customers  choose  levels 
of  service  that  are  functions  of  message  fidelity  and  message  delay. 
This  sort  of  network  tariff  plan  would  have  benefits  for  both  the 
users  and  the  network  managers.  The  user  pays  for  the  desired 
level  of  service,  balancing  his  requirements  against  the  network 
tariff  schedule.  The  network  managers  of  such  a  system  will  be 
able  to  allocate  resources  based  on  the  desired  level  of  network 
performance  with  respect  to  message  time  delay,  message  fidelity, 
and  volume  of  message  traffic. 

In  this  chapter,  the  network-level  rate  distortion  theory 
is  presented  and  relationships  between  message  fidelity,  time  delay, 
link  capacity,  and  message  volume  are  derived.  In  Section  2.2,  a 
brief  overview  of  rate  distortion  theory  is  presented.  In 
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Section  2.3,  the  network-level  model  is  formulated  along  with  key 
definitions.  In  Section  2.U,  the  major  results  for  computer- 
communication  networks  are  derived.  Section  2.5  concludes  Chapter  2 
with  a  summary  of  the  benefits  of  the  network-level  rate  distortion 
theory  and  a  brief  recapitulation  of  key  assumptions  and  results. 

In  Chapter  U,  a  detailed  network  example  is  used  to  illustrate  the 
conclusions  reached  in  this  chapter  regarding  rate  distortion  theory. 

2.2  A  Brief  Review  of  Classical 
Rate  Distortion  Theory 

The  mathematical  foundation  of  rate  distortion  theory  was 
presented  in  1959  by  C.  E.  Shannon  [l].  The  principle  conclusion 
was  "there  exists  a  rate  distortion  function  .  .  .  that  measures 
the  'equivalent  rate'  of  the  source  for  the  given  level  of 
distortion."  Further  elaboration  of  the  theory  has  been  concerned 
with  modeling  sources,  channels,  and  choosing  distortion  measures, 
with  excellent  summaries  of  the  classical  theory  contained  in 
[3,8]  and  especially  [2]. 

The  communication  system  model  for  which  the  theory  has 
been  developed  is  shown  in  Figure  2.1.  The  discrete  time  model 
consists  of  source,  user,  channel,  source  encoder/decoder,  and 
channel  encoder/decoder.  The  source  generates  a  message  m(t)  which 
is  a  member  of  a  set  of  pre-selected  messages.  That  is,  the  space 
of  possible  source  outputs  is  partitioned  into  a  set  of  equivalence 
classes.  The  source  encoder  indicates  the  appropriate  equivalence 
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Figure  2.1  Model  for  classical  rate  distortion  theory 


class  to  the  channel  encoder.  The  channel  encoder  transmits  the 
appropriate  message  waveform  s(t)  over  the  channel. 

The  channel  is  the  physical  link  between  the  source  and 
user.  Examples  of  channels  are  telephone  lines,  radio  propagation 
paths,  and  fiber  optic  cables.  For  the  purposes  of  this  model, 
channels  of  equal  capacity  and  identical  distortion  properties  are 
considered  equivalent.  On  the  user  side  of  the  channel,  the 
[possibly]  distorted  message  r(t)  is  presented  to  the  channel  and 
source  decoder.  The  decoder  makes  decisions  regarding  which 
equivalence  class  was  transmitted  and  presents  the  estimate  z(t)  of 
the  equivalence  class  to  the  user. 

The  mathematical  description  of  this  model  and  the 
definition  of  the  rate  distortion  function  R(D)  are  derived  from 
the  fundamental  concepts  of  information  theory.  (These  fundamental 
concepts  are  concisely  presented  in  [9].) 

To  quantify  this  concept  in  information-theoretic  terms, 
assume  a  source  alphabet  M  whose  members  are  the  letters  (m(j)} 
j  =  1,2,...M  and  a  user  alphabet  Z  whose  members  are  the  letters 
(z(k)}  k  *  1,2,3,...Z.  The  Joint  probability  P  is  defined  on  the 

jK 

cartesian  product  space  MZ  =  (m(j),z(k))  where  m(j)  =  J,  m(j)eM; 
z(k)  =  k,  z(k)cZ. 

Functions  may  be  defined  on  the  ensemble  of  alphabets  and 
the  Joint  probability  distribution.  The  random  variables  of 
interest  are  defined  via  the  relations 


29 


Pr[m(j)  = 

j).p3 

(2.1) 

Pr [ z ( k )  = 

kl 

(2.2) 

Pr[m(j)  *  J  and 

z(k)  *  k]  =  P 

JK 

(2.3) 

The  marginal  and  conditional  probabilities  are  related  in 
the  usual  way. 


P 


i 


M 

l 


k=l 


(2.U) 


Pj|k  =  PJk/Sc 


(2.5) 

(2.6) 


^Ij  *  P5k/PJ 


where  P^  |k  is  shorthand  for  P(j|k),  the  probability  that  m(j)  =  j 
given  that  z(k)  =  k. 

The  simplest  and  perhaps  most  useful  definition  of  the  rate 
distortion  function  assumes  the  information  source  to  be  a  discrete 
meiaoryless  source  (D.M.S.).  Consider  the  successive  letters 
generated  by  the  source  denoted  by  the  vector 


m  *  ( m^ , mgjin^ •  •  •  •  m^ ) 

where  m  is  the  source  letter  generated  at  time  t  . 
n  n 

For  the  D.M.S.,  it  is  assumed  that  the  successive  letters 
are  independent,  identically  distributed,  discrete,  random 
variables.  The  D.M.S.  model  exhibits  two  properties: 
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1.  The  source  output  is  stationary 

n 

2.  P(m)  =  n  P(m  ) 

t=l 

Thus,  the  source  can  be  completely  described  as  an  ensemble  {mt,P} 
where  is  a  random  variable  indexed  by  time  and  P  is  the  corre¬ 
sponding  probability  distribution.  The  D.M.S.  produces  the  output 
m  which  is  encoded  and  sent  over  the  channel  to  be  decoded  by  the 
user.  The  source  message  m  is  decoded  and  presented  to  the  user 
as  a  selected  word  z.  Associated  with  the  decoding  of  in  into  z 
(where  possibly  m  =  z)  is  a  cost  function  or  distortion  measure 
dn(n,z)  Indexed  by  n,  the  length  of  the  message  m.  Following  the 
definition  in  [2],  the  sequence  of  distortion  measures 


F  =  {d  (m,z),  1  <  n  <  «} 


[2.8) 


is  called  the  fidelity  criterion. 

A  special  class  of  fidelity  criteria  which  has  been  iden¬ 
tified  as  being  computationally  tractable  is  the  single  letter 
fidelity  criterion.  The  single  letter  criterion  is  the  average 
penalty  incurred  on  a  letter  by  letter  basis,  i.e. 

n 


d  (m,z)  *  ^  l  d(nL,z  ) 
n  n  t-l  ^  1 


(2.9) 


where  d(mt,zt)  is  the  single  letter  distortion  measure. 

Using  the  previously  defined  source  and  user  alphabets  and 
associated  probability  distributions,  the  average  distortion  between 


a  source-user  pair  can  be  written  as 
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^  s  ^  p  o  d 
J,k  rA|J  Jk 


(2.10) 


where  d  is  the  penalty  for  presenting  to  the  user  the  letter  z(k) 
Jk  ' 

where  the  source  selected  the  letter  m(j)  and  the  sum  is  over  all 
ro(j)eM,  z(k)eZ.  The  conditional  transition  probabilities  are 

called  D-admissible  if  D  ^  D,  for  some  fixed  D.  The  set  of 
D-admissible  transition  probabilities  is  set  obtained  from  the  rule 

Qd  =  {\|j:  D  <  D}  (2.11) 

The  average  mutual  information  is  defined  in  the  usual  way 


as 


K 


^  =  A  loe 


^1.1 

^  i 


(2.12) 


For  fixed  D,  the  rate  distortion  function  is  then  defined  by  the 
relation, 

R(D)  =  min  I(m,z)  (2.13) 

QcQp 


That  is,  R(D)  is  the  solution  to  a  convex  optimization  problem  in 
which  the  transition  probabilities  are  varied  and  the  solution  is 
subject  to  linear  equality  and  inequality  constraints.  Theoretical 
research  in  this  area  has  yielded  a  large  number  of  theorems 
describing  the  properties  of  F(D)  under  various  conditions.  Most 
of  these  theorems  are  not  necessary  for  the  development  of  this 
thesis,  so  the  interested  reader  is  referred  to  the  references, 
especially  [1,2,9].  However,  theorems  or  results  required  here 
will  be  developed  as  needed. 


The  significant  feature  of  R(D),  as  defined  here,  is  that 
it  depends  only  on  the  source  message  statistics  and  the  distortion 
measure.  While  this  definition  of  R(D)  has  been  the  mathematical 
basis  for  data  compression,  in  Section  2.3  the  rate  distortion 
concept  will  be  reinterpreted  and  applied  to  computer-communication 
networks . 

2.3  Rate  Distortion  Theory  and 
Computer-Communication 
Networks 

In  this  section,  the  network  problem  is  formulated  in 
information-theoretic  terms,  the  rate  distortion  function  for 
networks  is  defined,  and  suggestions  for  suitable  distortion 
measures  are  given. 


2.3.1  Problem  Formulation 

As  shown  in  Chapter  3  of  this  work,  the  flow  in  the  ith 

link  of  a  computer-communication  network  can  be  written  as 

l  rfcU,*)YJk  *  \  (2.U) 

J  »ko 

i-lewjk 

where  the  sum  is  over  all  commodities  which  flow  in  link  i,  r£(j,k) 
is  the  appropriate  routing  variable  for  the  (j,k)  traffic,  and 

0  <  r*(j,k)  <  1  (2.15) 

for  all  J,k;  also,  X^  is  the  total  flow  on  the  ith  link  in 
messages/sec.,  and  Yjk  is  the  average  rate  in  messages/sec  at  which 
traffic  enters  the  network  at  node  J  destined  for  node  k,  J  +  k. 


The  network  arrival  rates  are  assumed  to  be  independent  and 
Poisson.  This  assumption  is  equivalent  to  assuming  that  the 
network  message  sources  are  each  D.M.S.  with  respect  to  message 
generation. 

In  terms  of  a  single  channel  communication  model,  the 
multiple  commodities  on  link  i  are  viewed  as  being  transmitted  from 
several  sources  (one  soixrce  per  commodity),  and  independently 
encoded  and  placed  on  the  channel.  The  single  channel  embedded  in 
a  network  raises  questions  regarding  the  channel-network  inter¬ 
actions.  From  the  network  perspective,  there  are  three  logical 
levels  to  which  information-theoretic  questions  regarding  rate 
distortion  functions  and  information  capacities  should  be 
addressed: 

1.  The  link  level — What  are  the  effects  of  multicommodity 
flow  on  a  single  channel? 

2.  The  (j,k)  path  level — What  are  the  consequences  of 
having  source-user  (source-destination)  paths 
consisting  of  several  links? 

3.  The  network  level — Can  basic  sufficient  and/or 
necessary  conditions  be  established  at  the  network 
level  for  the  development  of  a  network  view  of 
distortion  and  capacity? 

The  following  paragraphs  address  the  questions  pertinent  to  these 
three  logical  levels . 
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2.3.2  Link  Rate  Distortion 
Function 

As  indicated  in  Chapter  1,  the  building  blocks  of 
computer-communication  networks  are  processing  nodes  and  communi¬ 
cation  links  connecting  these  nodes.  It  is  logical,  then,  to  start 
the  investigation  of  network  rate  distortion  characteristics  by 
examining  the  link  rate  distortion  function.  This  examination 
begins  by  defining  distortion  measures  for  message  and  packet 
switched  networks  and  then  examining  the  properties  of  rate 
distortion  theory  as  they  relate  to  multicommodity  flow  on  a  single 
channel. 

2. 3.2.1  Link  Rate  Distortion 
Measures 

The  classical  theory  of  rate  distortion  invokes  a 
single-letter  fidelity  criterion,  i.e.,  the  reproduced  letter  is 
compared  with  the  source  message  letter  on  a  letter-by-letter 
basis.  A  more  suitable  measure  for  computer-communication  networks 
would  compare  source  and  distination  messages  and/or  packets, 
possibly  including  the  message  or  packet  context.  For  this  study, 
eight  distortion  measures  are  introduced  in  this  section.  The 
proposed  distortion  measures  are: 

1.  Hamming  Distance  (binary  level) 

Suppose  that  the  received  packet  or  message  differs  from 

the  transmitted  vector  in  exactly  d  positions.  The  number  d  is 

m  m 

then  said  to  be  the  Hamming  distance  between  the  transmitted  and 
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received  messages  [ 10 ] .  On  the  binary  level,  assume  the  source 
message  or  packet  was  sent  as  m  e{0,l)  for  all  t,  and  the  received 

v 

message  was  z^etO.l}  for  all  t.  The  conditional  probability  of 

receiving  the  message  z  given  that  the  message  m  was  sent,  assuming 

that  the  probability  that  m  -  z  is  (1  -  p)  while  that  for  m  i  z 
J  n  n  *  n  n 

is  p,  and  that  there  are  d  errors,  is 

zn 

P  (z|in)  =  II  p(z  |m  )  =  p  m(l  -  p)  m  (2.l6) 

t=l  z  z 

where  as  before  n  is  the  message  length,  p  is  the  bit  error  rate, 
and  the  message  source  is  D.M.S.  For  the  binary  case,  the  Hamming 
distance  may  be  related  to  the  Hamming  weight.  If  modulo-2 
addition  of  binary  symbols  is  denoted  by  •,  and  if  the  Hamming 

.4.  -4 

weight  W(z)  is  defined  as  the  number  of  l's  in  a  binary  vector  z, 
then, 

d  =  W(z  9  in)  (2.17) 

m 

Using  the  Hamming  weight,  a  network  level  distortion  measure 

.4  4.  m 

d(m,z)  may  be  introduced.  The  Hamming  distance  distortion  measure 
is  defined  to  be 

d(m,z)  =  -  d  (2.18) 

n  m 

2.  Prioritized  Hamming  Distance  (binary  level) 

In  computer-communication  networks,  packets  and  messages 
have  varying  degrees  of  importance  to  the  users  and  to  the  network 
managers.  Control  traffic  is  essential  to  maintain  network 
functions,  while  users  may  impose  their  own  level  of  priority  on 


A 
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message  traffic  (and  pay  for  those  priorities).  This  suggests  that 
the  Hamming  distance  distortion  measure  should  be  indexed  by 
priority.  For  this  case,  the  distortion  measure  is  taken  to  be  a 
linear  function  of  priority  and  the  binary  level  Hamming  distance. 
The  distortion  measure  for  the  transmitted  message  m  and  received 
message  z  where  m  has  priority  P  is  taken  to  be 

d(m,z)  ®  -  d  +  P  (2.19) 

n  m 

.  ■+  . 

where  d^  =  W(z  ®  m)  and  n  is  the  message  length.  Other  forms  of 
distance  measures  with  non-linear  dependencies  on  priority  and 
Hamming  distance  suggest  themselves  and  are  topics  of  interest  for 
future  research. 

3.  Hamming  Distance  (character  level) 

Following  the  same  rationale  as  in  the  development  of  a  bit 
level  Hamming  distance,  suppose  that  the  received  message  z  differs 

->  Q 

from  the  transmitted  message  m  in  d  characters.  The  distortion 

m 

measure  is  then 

d(m,z)  (2.20) 

k  m 

where  k  is  the  message  length  in  characters. 

The  implications  of  using  this  distortion  measure  are  related 
to  the  differences  in  burst  error  rates  (sequences  of  errors)  and  bit 
error  rates.  Since  message  characters  are  composed  of  strings  of  n 
bits  where  n  is  typically  5,  8  or  16  bits,  burst  errors  will  contri¬ 
bute  to  increasing  the  bit  error  rate  directly,  but  will  not  have  the 
same  effect  on  the  character  error  rate.  For  example,  suppose  the 
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vector  m  was  ( 11011001 )  where  the  first  four  bits  comprise  one 
character  and  the  second  four  bits  comprise  another.  For  the 
purpose  of  the  example,  let  the  received  vector  z  be  (11011010). 
The  number  of  bit  errors  is  2  while  the  number  of  character  errors 
is  1.  This  example,  with  twice  as  many  bit  errors  as  character 
errors,  suggests  that  a  message  with  a  number  of  bit  errors  may 
still  be  quite  acceptable  to  the  user  because  the  number  of 
character  errors  is  small. 


4.  Prioritized  Hamming  Distance  (character  level) 

For  the  same  reason  given  in  the  description  of  the 
Prioritized  Hamming  Distance  (binary  level),  a  character  level, 
prioritized  distortion  measure  may  be  appropriate.  The  measure 
introduced  here  is 


d(m,z)  »  d°  +  P 
k  m 


12.21) 


where  P  is  the  priority  level,  d^  is  the  character  level  Hamming 
distance,  and  k  is  the  message  length. 

The  remarks  pertaining  to  other  forms  of  the  functional 
dependence  for  a  prioritized  distortion  measure  are  also  applicable 
here.  The  remaining  three  distortion  measures  are  formed  by 
normalizing  the  average  of  the  previously  defined  metrics.  Let 
D*  denote  the  normalized  average  measure,  then  the  relationship 
between  the  normalized  and  unnormalized  metric  is 


max  [ D1 ] 


(2.22) 
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l  rJ(J*k>YJk  =  X±  (2.25) 

where  the  sum  is  over  all  commodities  which  flow  in  link  i,  r^(j>k) 
is  the  routing  variable  for  the  (j,k)  traffic  and 

0  <  r*(j,k)  <  1  (2.26) 

In  this  problem  formulation,  the  traffic  statistics  y  are 

jK 

known  to  be  Poisson  and  independent.  The  question  then  is,  what 
are  the  properties  of  the  rate  distortion  function  for  the  ith 
link? 

To  begin  the  investigation,  the  communications  model  for 
the  ith  link  is  shown  in  Figure  2.2.  The  model  consists  of  a  group 
of  subsources  representing  the  sum  [  r^(j,k)Yjk*  Each  subsource  is 
a  Poisson  message  generator  with  average  intensity  r*(j,k)Yjk.  The 
subsources  are  assumed  to  be  independent.  The  group  of  subsources 
merge  their  messages  into  a  common  message  stream  which  is  also 
Poisson  with  average  intensity  An  alternative  formulation  of 

this  problem  would  be  to  view  the  communication  process  as  a 
two-person  statistical  game  [ 11  ] .  In  such  a  formulation,  message 
source  statistics  are  assumed  to  be  entirely  unknown  and  the 
results  are  dependent  on  the  rules  of  the  game  [ 12 ] . 

Since  the  characteristics  of  the  traffic  requirements 
matrix  [y,.  ]  are  known,  a  direct  approach  may  be  used  in  evaluating 

,  JK 

the  mathematical  properties  of  the  ith  network  link,  as  opposed  to 

. 

the  game-theoretic  approach. 

I 

! 

! 

t 


First,  the  properties  of  the  rate  distortion  function  for 
the  ith  link  (denoted  by  R*(D*))  are  derived  for  a  single  commodity. 
Then,  extensions  are  made  to  find  the  properties  of  R*(D*)  for 
multicommodity  flow  where  these  properties  are  different  from  those 
of  the  single  commodity.  For  the  case  of  a  single- commodity  in  the 


ith  link,  the  intensity  is 


xi  =  ri(j’k)Yjk 


(2.27) 


and  is  simply  comprised  of  messages  entering  the  network  at  node  j 

and  destined  for  node  k,  j  ^  k.  The  probability  that  the  source  at 

-► 

node  j  transmits  message  ms  is  defined  to  be 

Pr[in  transmitted  at  node  J  destined  for  node  k]  =  P^(j,k)  (2.28) 

s  s 

The  probability  that  the  message  ms,  a  member  of  the  (j,k)  message 

set,  is  transmitted  on  the  ith  link  is  defined  to  be 


Pr[m  transmitted  an  ith  link]  =  P1(j,k) 
s  s 


(2.29) 


In  the  absence  of  distortion  and  for  a  single  commodity  flow  on  the 


ith  link 


P£(j,k)  =  rJ(J,k) 


(2.30) 


The  transition  probability  that  the  message  z^  is  received  on  the 
ith  link  conditioned  on  the  event  that  the  message  ins  was  trans¬ 
mitted,  is  denoted  by, 

Pr[z  received  on  ith  link  given  that  message  in  was  transmitted] 

w  S 

■  Qt|s  (J.*J  (2.31) 


x 


1*2 


The  notation  (J,k)  is  necessary  to  denote  the  commodity  being 
specified  on  the  ith  link.  Figure  2.3  is  a  schematic  of  the 
relationship  between  the  transmitted  and  received  messages  on  the 
ith  link. 

The  average  distortion  for  the  ith  link  for  the  single  (J,k) 
commodity  is 

B1  -  5  )  (2.32) 

s  ,t  ' 

where  d1(m  ,z. )  is  the  distortion  measure  for  the  ith  link, 
s  t 

As  in  the  classical  theory,  the  transition  probabilities 
<at,s(j.k)>  are  called  D1-admissable  if  D*  <  Di .  The  set  Q^(j,k) 
of  D1-admissable  transition  probabilities  on  link  i  for  j,k  traffic 
is  defined  by 

Q*(j,k)  *  {q£  |8(j,k):  51  <  D1}  (2.33) 

The  average  mutual  information  on  the  ith  link  for  a  single 
(j,k)  commodity  is 
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IT,,  (c,z) 


Q*(j,k 


k) 

) 


(2.31*) 


where  the  sum  is  over  the  set  of  all  possible  input  messages  (ms) 
and  all  possible  output  messages  (z^J.  The  rate  distortion 
function  on  the  ith  link  for  the  (j,k)  commodity  is 


Rjk^D1 )  *  nin  Ijk(m,z) 

Qj(j.k) 


e 

m 


A 


Ml 


(2.35) 
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For  a  single  commodity,  R^j  (D*)  is  the  measure  of  interest 

JK 

on  the  ith  link.  For  a  multicommodity  flow,  the  presence  of  addi¬ 
tional  commodities  must  be  considered  in  the  calculation  of  the  link 
rate  distortion  function. 

The  average  mutual  information  on  the  ith  link  for  all 
commodities  is  dependent  on  the  joint  probability  functions  for  all 
commodities.  For  example,  the  input  message  probabilities  for 

message  m  and  all  traffic  J, , j„ , j . •k1  ,k  ,k  , . . . ,  which  can  be 

.■+  .  i 

abbreviated  as  (J,k),  is  denoted  by  Pg(J,k)  and  similarly  for  the 
transition  probabilities. 

The  general  link  average  mutual  information  is 


I1 (m,z)  =  l  P*(j,k)Q*.  (J,k)  log 
s,t 


J,k 


L  J 


(2.36) 


where  the  sum  is  over  the  cartesian  product  spaces  of  all  possible 
input/output  message  pairs,  and  s  and  t  may  be  thought  of  as  n-tuples 

formed  by  the  union  of  all  input  message  sets  and  output  message 

.  . 

sets,  respectively.  The  message  set  {msJ  can  be  written  in  terms 

of  the  commodities  comprising  it,  i.e., 

{m  }  =  {m  }  U  {in  }  U  {m  }  U  . . . 

1  2  3 

where  s^.Sg...  are  the  indices  for  the  constituent  commodities 


Th 


e  message  set  { z  >  is  formed  in  an 

V> 


analogous  fashion. 
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Because  of  the  source  independence,  the  general  expression 
may  be  further  simplified.  Noting  that  source  independence  implies 
that  message  probabilities  factor,  one  has  that 


Pg(J.it)  -  Pg  (J1,k1)P^(J2,k2)pMj3,k3).... 

The  average  mutual  information  then  simplifies  to 

.  .  .  ,  .  |e( j ,k) 

1 1  ( m , z )  =  l  l  P*(j,k)Q*.  (j,k)  log  - 

J.k  s,t  3  tls  L  Qt(j’k)  . 

=  l  I^.(m,z) 

J,k 


(2.37) 


(2.38a) 


(2.38b) 


The  summation  is  over  all  possible  input  message/output  message 
pairs  for  each  commodity  flowing  on  the  ith  link. 

Then  for  fixed  D1 ,  the  rate  distortion  function  for  the  ith 
link  is  defined  as 

(2.39) 


Ri(D^')  =  min  I*(m,z) 


where 


i  =  {*ii5  = 5i  <ci} 

The  solution  for  R1(D1)  is  thus  a  convex  mathematical  programming 
problem.  Specifically,  the  average  mutual  information  I1(m,z)  is 
a  convex  function  of  a  vector  variable  (which  is  also  convex)  and 
must  be  minimized  subject  to  the  linear  equality  and  inequality 
constraints 

Qj|g(j,k)>0  ( 2 . UOa ) 


U‘ls(j,k)  -i 


(2.U0b) 


1*6 

l  P3(J,k)Q^|s(j,k)di(Sg,lt)  =  C1  (2.1*1) 

J  *k 
s  ,t 

In  the  example  of  Chapter  U,  a  link  rate  distortion  function 
will  be  calculated  and  applied  to  a  network. 

Under  very  general  conditions,  the  link  rate  distortion 
function  (RDF)  is  decomposable  into  the  individual  commodity  rate 
distortion  functions  on  the  link,  as  the  following  theorem  shows. 


RDF  Decomposition  Theorem 

Assume  that  two  commodities  flow  on  link  i  with 

.  a  b 
X.  =  y  +  Y 

where  a,  b  are  the  commodities,  and  a,  b  are  independent,  each 

with  its  own  distortion  measure  d*a(m  , z  ) ,  dib(in  , , z  , )  and 

S  Tf  S  u 


1 GL  1.  CL 

individual  distortion  functions  R  a(Dia)  and  R1D(D1D)  respectively. 
Then, 

R1  (D1 )  =  Rla(Dla)  ♦  Rlb(Dlb)  (2.1*2) 

and 


>ib/~ib. 


D1  =  Dia  +  Dib 

Proof.  The  transition  probabilities  for  the  two  independent 
commodities  y&  and  yb  are  denoted  as  Q*?  and  Q*bi  , 

L>  I  S  v>IS« 

The  transition  probability  for  R*(D^)  is  denoted  by  Q  , i  , 

X>  I  S  S  « 

First,  it  is  shown  that  for  any  minimal  assignment 
{CiU’|ss'}’the  Product  {<|s^|s’ 


}  gives  the  same  distortion. 
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Choose  the 


such  that 


s,t 


s  wtt‘ 


I  ss  1 


(2.1*  3a) 


(2.U 3b) 


where  P**,  are  the  input  message  probabilities  for  the  two 


aa 


Nib 


commodities  on  link  i.  Then,  Qt • | s *  are  c*early  satisfactory 

probabilities  and  give  the  same  total  distortion  as  the  product 
assignment  as  seen  in  the  following  argument.  First,  the 
distortion  given  by  the  product  is 


,1  'SWr!'u“(vV  *  *lb‘v-v» 

S  S  9  tt 

-  It  WfA-s'  *  «■“> 


which  is  also  the  distortion  using  t ’ I ss  *  * 


Second,  the  choice  ,Q* i  ,  is  less  than  or  equal  to  the 

L  I  S  u  |  S 


minimum  given  by  the  Joint  probability,  Q  ,i  , 

X>  u  I  S  S  • 

Using  the  entropy  function  in  the  usual  way. 


R1(D1)  =  H(s ,s ' )  -  H(s ,s ' jt,t?) 

>  H(s.s')  -  H(s|t)  -  H(s* |t ' ) 

=  H(s  ,s ' )  -  K(sjt)  -  H(s'lt')  (2.1*5) 

*>  i.  sl  ife 

where  H()  denotes  an  entropy  with  the  product  assignment  ®tjs®t*|si 

fit  b 

Since  the  commodities  y  .  Y  are  independent,  then 


H(s.s’)  =  H(s)  +  H(s’)  =  H(s )  +  H(s') 


(2.1*6) 
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and 

R^D1)  >  Ria(Qia)  +  Rib(Qib)  (2.1*7) 

Since  R^(D^)  is  the  minimum  over  the  convex  space  Q^,  it  follows 
immediately  that 

R1(Di)  =  Ria(Dia)  +  Rlb(Dlb)  Q.  E.  D.  (2.1*8) 

The  importance  of  this  theorem  is  that  it  allows  the  network 
designer  to  evaluate  the  rate  distortion  on  a  commodity  by  commodity 
basis  and  then  design  individual  network  links  to  maintain  a 
prescribed  link-level  of  distortion. 

2. 3.2. 3  A  Link  Capacity  Measure 

Intrinsic  to  the  development  of  rate  distortion  functions 
for  computer  networks  is  a  usable  definition  of  network  capacity. 

The  foundation  of  that  definition  is  the  link  capacity.  The  link 
capacity  in  bits  per  message  per  channel  usage  is  defined  as 

=  max  I^m.z)  (2.1*9) 

{Ps> 

That  is,  the  link  capacity  for  a  discrete  memoryless  channel  is  the 
maximum  of  the  average  mutual  information  with  respect  to  all 
possible  input  message  probabilities.  To  make  a  useful  measure 
requires  knowledge  of  Tc,  the  time  period  for  each  message  trans¬ 
mission.  When  Tc  is  known,  then  the  link  capacity  is 

C^/T  bits/sec-msg 


C.  * 
x 


(2.50) 


t 


» 


1*9 

In  practice,  is  known  a  priori  for  a  particular  link  and 
calculations  proceed  from  there.  In  Chapter  **,  a  link  capacity  is 
calculated  by  maximizing  the  average  mutual  information. 


2.3.3  Routing  Level  RDF 

Given  that  the  RDF  can  now  be  calculated  for  a  specific 

link  or  for  a  single  comnodity  on  a  specific  link,  what  may  be 

inferred  regarding  the  (j,k)  traffic  following  a  path  ir  or  paths 

jK 

£ 

ti  .  ?  Single  path  routing  and  alternate  routing  are  considered  in 
JK 

the  next  two  subsections . 


2. 3. 3-1  Static  Routing 
(Single-Path 
Routing)* 

Assume  that  commodity  (j,k)  is  routed  over  n  links 
comprising  path  ir^.  On  the  first  link,  the  (j,k)  commodity  will 
have  the  RDF  R^  (D1) 

jK 


R^D1)  =  min  I*  (in,z) 


1 

Where  the  average  mutual  information  I  (m,z)  is 

JK 


(2.51) 


I 


1 

Jk 


(m,z) 


■  l  Pg(j»k)Q^i  (j,k)  log 


^t|s(.1,k) 

oJ(j,k)  . 


(2.52) 


The  notation  indicates  this  is  the  average  mutual  information  on 

the  first  link  of  the  path  tt  for  the  (J,k)  commodity.  The 

JK 

expression  for  the  second  link  is  similar. 


I 
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l  pJ(j,k)Q^|s(j,k)  log 


Qtls(j,K) 

Qj(J.k) 


(2.53) 


In  this  model,  the  output  of  the  second  link  depends  statistically 
only  on  the  input  to  this  link,  so  that  in  the  expression  for 
the  second  link,  the  input  probabilities  Pg(j,k)  then  depend  on 
the  transition  probabilities  of  the  first  link  and  the  message 
input  probabilities  of  the  first  link  through  the  relation 


P3( J  »k)  =  l  P*  (j.k)Qj.  (J,k) 
a,  1  1  1 


(2.5b) 


In  evaluating  R^,  (D^)  the  set  of  transition  probabilities 
JK 

(^s|a^  were  selected  to  minimize  Ijk(m,z)  and  are  thus  known  in  the 

2  2  2 

above  equation  for  P2(j,k).  R  ^  ^  ( D)  is 


Rjk(D2)  *  min  Ijk(m,z) 

Q^(J.k) 


(2.55) 


The  average  mutual  information  for  the  nth  link  is  then 

Q?.  (J,k) 

I^k(®’z)  *  I  iog  — ~~ — 

Jk  s.t  s  t|s  /  Qj(j,k)  (2.56) 


where  the  nth  line  message  input  probabilities  can  be  related  to 
the  source  message  probabilities  and  the  link  transition  proba¬ 
bilities  on  the  path  n  ,  by  the  relation 

JK 
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P°(J.k>  =  I  Pa  n  (J?k)  QsTa(j’k)  (2'57) 
5  al,&2*  ‘  *aiwl\  I*7  i+1  K/  "-1 

If  the  link  transition  probabilities  are  identical  over  the  path 
njk’  i'e'»  if 


for  all  1,  s,  and  t,  the  expression  for  the  input  probabilities 

can  be  expressed  as  a  homogenous  discrete-time  Markov  chain  where 

the  input  probabilities  P^(j,k)  represent  initial  state  proba- 

s 

bilities.  Specifically,  let  ?^(j,k)  be  the  column  vector 


(2.58) 


|_P*(j,k)J 

where  the  entries  are  the  message  probabilities  for  the  £th  link, 

and  define  the  transition  matrix  £(J,k)  for  the  path  u  to  be 

JK 


§.(j,k)  =  [Qm|n(j,k)]  (2.59) 

where  the  element  Q  i  (J,k)  is  in  the  mth  row  and  nth  column.  Then, 
m  I  n 

the  result  for  the  £th  link  input  probabilities  is 


P*(j,k)  *  [a(J.k)]£P1(j,k)  (2.60) 

£ 

where  [S.(j,k)]  is  the  fcth  power  of  the  transition  matrix  and 
^(j.k  )  is  the  vector  of  input  message  probabilities  for  the  first 


link. 
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Here,  one  must  distinguish  between  the  transition 
probabilities  «5  **c ^  wh*-ch  determine  the  input  message  proba¬ 

bilities  in  successive  links  and  the  set  Q^(j,k)  which  is  varied 
subject  to  maintaining  the  average  distortion.  The  former 
transition  probabilities  are  determined  by  the  link  characteristics, 
while  the  latter  is  the  set  of  transition  probabilities  over  which 
the  mutual  information  is  varied  until  the  greatest  lower  bound  is 
obtained. 

The  rate  distortion  measure  for  the  single  commodity  with 
static  routing  ((J,k)  traffic)  is  defined  to  be 


and 


VD) 


=  i  J 

n 


fceit 


Jk 


RjVD*} 


(2.61) 


«I° 

fceir 


Jk 


where  the  summation  is  over  the  n  links  which  comprise  path  ir  . 

jK 

g 

(If  additional  clarity  is  needed,  the  rotation  D,.  and  D,.  can  be 


Jk 


Jk 


used  for  D  and  D  ,  respectively.) 


Unfortunately  R  ( D )  is  not  a  useful  measure  in  general. 

JK 

However,  for  certain  cases,  e.g.,  equi probable  input  message  distri¬ 
butions,  the  (j,k)  traffic  level  RDF  is  readily  calculable  and  is 
important  in  characterizing  network  performance,  as  will  be  shown  in 

Chapter  U.  Additional  remarks  and  results  concerning  R  (D)  are  also 

JK 

presented  in  Chapter  U  along  with  a  computational  example. 


V 
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2. 3. 2. 2  Alternate  Routing 

In  the  case  of  message  streams  being  split  between  source 
and  destination,  as  in  the  minimum  hop  algorithms  proposed  in 
Chapter  3,  the  traffic  intensity  for  a  given  commodity  is  scaled  by 
the  routing  variable  on  the  ith  link, 

r»(J»k)y  -  J-kth  component  of  X. 

X  jK  1 

The  message  input  probabilities  at  the  source  are  not 
affected  by  alternate  routing  and  the  input  probabilities  for  each 
routing  are  determined  as  in  the  static  case.  The  average  measure 
for  alternate  routing  is  an  extension  of  the  single  routing  measure 
and  is  defined  to  be 


**  . 
m  m  l 

ra  „  m 
men.,  ten., 
Jk  Jk 


(2.62) 


and 

C  »  2  D* 

,s"jk 

where  the  summations  are  over  all  m  alternate  routings  and  the  n 

m 

links  of  each  of  the  m  alternate  paths ,  where  n®  denotes  the  mth 

Jk 

alternate  path  for  the  (j,k)  traffic.  The  caveats  following 
Eq.  (2.6l)  pertain  here  also. 

2.3.1*  Routing  Optimization 
Strategies 

Traditionally,  the  driving  design  parameter  in  message  and 
packet  routing  strategies  has  been  link  capacity  constraints. 


Iki 


- - -  .  - - 


However,  by  accepting  message  distortion  as  a  design  variable,  an 
additional  degree  of  freedom  is  added  to  possible  routing  strategies 
in  the  form  of  variable  link  capacities.  The  implications  of  this 
additional  degree  of  freedom  require  the  detailed  study  which  is 
given  in  Chapter  3.  However,  the  potential  routing  strategies  are 
introduced  here  as  part  of  the  logical  development  of  this  chapter. 
The  strategies  are: 

1.  Minimization  of  Path  Rate  Distortion  via  Minimum  Hop — 
One  practical  form  for  the  minimization  of  message  distortion  is  via 
the  minimization  of  the  average  number  of  links  the  set  of  all 
commodities  traverse.  This  is  the  network  minimum  hop  routing 

(a  hop  occurs  each  time  a  link  is  traversed  by  a  commodity)  and 
minimizes  the  objective  function 

J  -  7  l  \  (2.63) 

This  strategy  is  of  greatest  interest  because  of  its  practicality 
and  is  thoroughly  examined  in  Chapter  3. 

2.  Path  Rate  Distortion  Equalization  (PRDE)— The  goal  of 
the  strategy  is  to  equalize  the  ratio  Ci/R1(D1)  for  all  links.  The 
effect  is  to  balance  message  rates  throughout  the  network. 

3.  Path  Rate  Distortion  Prioritization  (PRDP)— The 

objective  of  this  policy  is  to  maximize  the  ratio  C../R  (D)  for 

JK 

some  commodities  at  the  expense  of  others,  i.e.  to  give  a  higher 
priority  to  certain  comnodities . 
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2.3.5  Network  Capacity  and 
Relation  between 
Message  Delay  and 
Rate  Distortion 

In  previous  sections,  the  network  queueing  model  has  been 
presented  as  has  a  network  model  for  representing  message  errors. 

One  expects  that,  since  the  network  message  traffic  is  susceptible 

both  to  queueing  delays  and  distortion  due  to  noise,  a  functional 
relationship  can  be  developed  between  the  information- theoretic 
results  and  the  queueing- theoretic  results.  In  this  section,  such 
a  relationship  is  developed  and  as  a  corollary  to  that  work,  the 
concept  of  single  channel  capacity  is  extended  to  the  network  level. 

In  Section  2. 3. 5-1,  the  network  capacity  is  introduced  and 
defined.  In  Section  2. 3. 5. 2,  the  queueing  delay-rate  distortion 
relationships  are  analyzed  and  the  results  are  illustrated  via  an 
example  in  Chapter  U. 

2. 3.5.1  Network  Capacity 

In  Section  2. 3.2. 3,  the  link  or  single  channel  capacity 

measure  was  defined  in  terms  applicable  to  network  usage.  These 

results  rely  on  the  single  channel  message  network  definition  for 

capacity  C^  (or  equivalently  C^  in  units  of  bits/second). 

The  network  measures  are  defined  here  in  terms  of  traffic 

requirements  and  network  topology.  The  definitions  are  formulated 

in  an  information-theoretic  context  with  the  focus  on  network 

applicability.  The  path  capacity  C,.  for  a  jk  path  of  n  links  is 

JK 


defined  as 
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i  eit 


Jk 


(2.6U) 


If  alternate  routing  is  used  for  (j,k)  traffic,  the  definition  is 
obviously 


\  rft(j,k)  l  Ci  ~  l  C 


icn 


Jk 


iETT 


l 

ten 


Jk 


Jk 


Jk 


(2.65) 


where  r.(j,k)  is  the  routing  variable  for  the  ith  path  for  the  (j,k) 

£ 

traffic  and  the  summations  are  over  all  (j,k)  traffic  paths  it  and 

JK 

4 

over  the  links  in  each  In  the  case  of  static  routing,  the 

requirement  for  finite  distortionless  message  delay  leads  to  the 
necessary  condition 

(2.66) 


C,k  >  n(  l  y  )i 

Jk  j  k  JK  y 


1  . 


where  n  is  the  number  of  links  in  path  *  .  ,  —  is  the  average  message 

0  K  y 


length,  and  the  summation  is  over  the  commodities  flowing  on  the 

links  defined  by  n  . 

JK 

The  corresponding  necessary  condition  for  the  case  of 
alternate  routing  is 


cjk  >  I  rt(j,k)n‘(  l  vk)i 

.  I  A 

U  it..  C.  en, 

i  Jk 


(2.6?) 


Jk 


£  Q 

where  n  is  the  number  of  links  in  path  it,.  .  Finally,  these 

JK 

capacity  results  can  be  applied  to  a  generalized  network.  Let 
CT  =  the  capacity  of  the  network.  The  appropriate  definition  for 
total  network  capacity  is 
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■  ,Lci  -  .1 


J  »k 


'Jk 


(2.68) 


where  there  are  M  links  in  the  network. 

For  the  general  case  of  alternate  routing,  the  necessary 
condition  for  finite  distortionless  message  delay  becomes 


CT>  I  l  r  (j,k)n*(  l  y  )i  (2.69) 

T  J.k  «  ,  J,k  ,Jk  W 

lew,.  C.ew 

Jk  i 

The  necessary  conditions  represent  a  least  lower  bound  on  required 
network  capacity  for  error-free  communications. 

Of  course,  the  upper  bound  on  network  capacity  is 
constrained  by  cost  and  available  technology. 


2. 3. 5- 2  Queueing  Delay  and 
Rate  Distortion 

In  section  2. 3. 5-1*  above,  a  definition  of  capacity  was 
introduced.  The  definition  characterizes  link  capacity  in  units  of 
bits/message-channel  usage.  Compatible  with  and  related  to  that 
capacity  definition  is  the  link  rate  distortion  function  R1(D1) 
which  has  the  dimensions  of  bits/source  message.  The  primary 
result  from  classical  distortion  theory  which  is  brought  to  this 
development  is  the  change  in  channel  capacity  due  to  the  RDF  R1(D1). 
The  effective  link  capacity  becomes 


'i  eff 


TcRl(DX) 


messages 

sec 


(2.70) 


where  the  period  of  a  channel  usage  is  Tc  and  was  defined  in 
Section  2. 3.2. 3. 

In  practice ,  Tc  may  be  calculated  from  fundamental 
considerations  of  hardware  (modem/terminal/line)  and  software 
(protocols/coding)  characteristics . 


The  above  equation  may  be  taken  to  mean  that  the  link 
capacity  is  increased  by  1/R1(D1)  when  messages  are  transmitted 
with  an  average  distortion  not  exceeding  .  For  the  broad  class 
of  network  models  in  which  queueing  delay  is  a  fun'  tion  of  link 
capacity  and  message  flow  rate,  i.e., 

=*  f(Xi,Ci)  (2.71) 


there  is  an  explicit  assumption  of  communications  reliability. 
That  is,  the  communications  are  assumed  to  be  error-free.  With 
this  work,  however,  the  queueing  delay  becomes  a  function  of 
distortion  D1 ,  as  well  as  X^ ,  and  .  Hence, 


T. 

l 


“VW 


T  Rl(D1)u 
c 


(2.72) 


or,  in  general, 

Ti  =  g(xi*Ci,Tc,Bi(Di),w) 

where  g  is  a  convex  function  of  X^.  Using  the  explicit  example 


of  Chapter  1,  one  has 
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and  making  the  necessary  changes  in  notation  yields 

T (A  ,C.,R1(D1))  =  - R— D.  }  ■-  (2.1k) 

1  C.  -  X.RX(D  ) 

where  c/pT  has  been  combined  into  C. ,  the  capacity  measure  in 

1C  1 

units  of  messages /sec .  For  a  typical  R1(D1)  as  shown  in 
Figure  2.k ,  has  the  behavior  shown  in  Figures  2.5  and  2.6. 

Clearlv,  T.  remains  convex  in  A.,  for  fixed  D1  and  C. .  For  fixed 
-  l  1  l 

Ci  and  A^,  is  concave  since  R1(D1)  is  concave. 


For  finite  message  delay,  T\  <  <*>,  the  message  rate  is 
bounded  by 


X.  <  C./R^D1)  (2.75) 

For  fixed  C^,  that  bound  is  convex  as  a  function  of  distortion. 

This  is  intuitively  satisfying,  since  here  the  claim  is  that  the 
message  rate  X^  may  be  increased  if  message  distortion  is  allowed 
and  the  message  delay  will  still  remain  finite. 

Using  the  network  queueing  model  from  Chapter  1,  the 
average  message  delay  in  the  network  is  found  to  be 


T 


A.R^D1) 

C.  -  X.R1(D1) 

l  l 


(2.76) 


for 

D1 .  <  D1  <  D1 

min  max 
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In  Chapter  h ,  the  interrelationship  between  message 
distortion  and  queueing  delay  is  fully  illustrated  via  a  network 
example . 

2.U  Conclusions 

The  principal  result  of  this  chapter  is  the  message 
distortion— queueing  delay  relationship  developed  in  Section  2.3. 
The  information-theoretic  approach  has  produced  a  remarkably 
simple  method  for  handling  network  distortion.  This  general  model 
and  its  relatively  simple  methodology  should  be  contrasted  with 
the  specialized  model  in  [lM  or  the  unwieldy  generating  function 
methodology  used  in  [15, l6] . 
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Chapter  3 


POUTING  STRATEGIES 

3-1  Introduction  to  Chapter  Three 

The  purpose  of  this  chapter  is  to  examine  in  detail  the 
routing  strategies  briefly  mentioned  in  Chapter  2.  The  focus  will  be 
on  the  Minimum  Hop  (Min-Hop)  policy  for  two  reasons.  First,  it  opti¬ 
mizes  the  network  performance  from  an  overhead  traffic  and  message 
distortion  perspective.  Second,  it  could  be  implemented  in  a  general 
large-scale  network  either  as  a  centralized  or  decentralized 
algorithm.  This  research  has  developed  several  methods  for  calcu¬ 
lating  and  implementing  the  Min-Hop  policy  and  these  developments 
will  be  presented  in  Section  3.2.  It  should  be  noted  that  much  of 
the  research  included  in  Section  3.2  has  been  published  or  submitted 
for  publication  in  [l],  [2],  and  £ 33 -  Section  3.3  analyzes  the 
implications  of  the  Path  Rate  Distortion  Equalization  (PRDE)  policy 
for  network  implementation  of  the  PRDE  strategy  is  also  presented. 
Section  3.^  presents  the  implementation  methodology  for  the  network 
optimization  via  Path  Rate  Distortion  Prioritization  (PRDP),  The 
chapter  concludes  with  Section  3.5,  a  review  of  salient  features  of 
the  three  routing  strategies. 

3.2  The  Min-Hop  Strategy 

The  Min-Hop  Strategy  is  to  minimize  the  number  of  links  each 
commodity  traverses,  i.e.,  minimize  the  number  of  hops  messages  make 


in  moving  from  source  to  destination.  In  the  following  paragraphs 
the  Min-Hop  strategy  is  developed  and  analyzed  in  detail  and  illus¬ 
trated  using  network  examples.  In  Section  3.2.1,  the  rationale  for 
emphasizing  the  Min-Hop  policy  and  its  key  position  as  an  optimizer 
of  network  performance  with  respect  to  message  integrity  is 
presented.  In  Section  3.2.2,  the  basic  optimization  problem  is 
presented  and  a  dynamic  programming  approach  to  the  calculation  of 
the  Min-Hop  flow  assignment  is  developed  and  illustrated  with  a 
network  example.  In  Section  3.2.3,  a  centralized  Min-Hop  routing 
algorithm  constrained  by  average  end-to-en?-  message  delay  is 
developed  and  illustrated  with  a  network  example.  A  decentralized 
algorithm,  in  two  parts,  is  developed  and  presented  in  Section  3-2.1. 
The  first  part  of  the  distributed  algorithm  yields  a  Min-Hop  flow 
assignment  and  the  second  part  modifies  the  flow  assignment  to 
satisfy  end-to-end  delay  constraints. 

3.2.1  Rationale  for  Min-Hop 
Strategy 

The  Min-Hop  algorithm  proposed  in  this  research  is  designed 
to  avoid  store  and  forward  congestion  due  to  certain  features  found 
in  real-world  networks.  The  features  which  contribute  to  thruput 
degradation  and  system  deadlock  are  the  finite  capacity  communi¬ 
cation  lines,  the  finite  capacity  buffers  of  the  switch  nodes,  and 
the  presence  of  noise  on  the  communication  links.  These  three 
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features  are  examined  in  the  following  paragraphs  and  the  relation 
to  the  Min-Hop  algorithm  is  highlighted. 

In  an  actual  network,  the  switching  nodes  (communications 
processors)  have  a  finite  amount  of  storage  for  holding  incoming 
and  outgoing  packets.  The  packets  reside  in  what  may  be  considered 
for  modeling  purposes  as  a  common  buffer  pool.  When  the  buffer  is 
full,  incoming  packets  can  not  be  received  and  are  lost  to  the 
system  or  have  to  be  retransmitted  thus  contributing  to  channel 
congestion  and  consequent  performance  degradation.  To  avoid  this 
system  condition,  various  flow  control  policies  have  been  formulated, 
the  most  prominent  group  of  policies  being  variations  of  channel 
queue  limit  mechanisms.  In  one  common  version  of  the  channel  queue 
limit  mechanism,  the  switching  node  will  signal  other  nodes  that  a 
certain  percentage  of  the  buffer  capacity  is  occupied  and  that  no 
further  packets  will  be  accepted.  This  requires  potential  senders 
to  hold  the  packets  intended  for  that  switching  node  so  that  the 
packets  are  not  lost.  This  mechanism  can  result  in  source-to- 
destination  deadlock.  As  an  illustration  of  source-to-destination 
deadlock  consider  Figure  3.1.  An  end-to-end  path  is  shown  embedded 
in  a  general  network.  The  nodes  A  thru  D  are  connected  to  other 
nodes  (not  shown)  in  the  general  network.  Source  node  A  wishes  to 
transmit  to  destination  node  D  via  intermediate  nodes  B  and  C. 
Suppose  node  C  has  reached  its  channel  queue  limit  due  to  heavy 
traffic  involving  other  commodities.  Then  node  B  would  hold  packets 
destined  for  node  C.  Eventually  node  B  would  reach  its  buffer 


threshold  and  no  longer  accept  packets.  Source  node  A  would  not  be 
able  to  transmit  to  destination  node  D,  resulting  in  the  form  of 
congestion  known  as  source-to-destination  deadlock. 

To  quantify  this  concept,  suppose  the  network  is  well 
balanced  such  that  line,  node,  and  buffer  utilizations  are  approxi¬ 
mately  the  same.  Assume  further  that  regardless  of  the  buffer 
partitioning  policy,  the  probability  of  a  node  reaching  its  channel 
queue  limit  is  the  same  for  all  nodes,  i.e., 

Pr[node  i  reaches  threshold]  =  p  (3.1) 

for  all  nodes.  For  a  path  it  ^  with  n  links  and  n  ♦  1  nodes,  the 
probability  that  a  deadlock  condition  is  obtained  is, 

m  .  , 

Pr [ source-dest ination  deadlock]  *  £  (")p  (1  -  p)n_  (3-2) 

k«l 

where  (£)  is  the  Bernoulli  coefficient.  Clearly  by  minimizing  n, 
which  is  a  feature  of  the  Min-Hop  algorithm,  the  probability  of 
deadlock  is  minimized. 

The  second  'real'  aspect  of  networks  is  the  finite  line 
capacity  and  the  associated  communication  cost.  In  fact,  this  tends 
to  be  the  most  serious  bottleneck  in  networks  and  the  most  signif¬ 
icant  cost  factor,  especially  in  local  area  networks.  Clearly,  by 
implementing  Min-Hop  policies  the  number  of  communication  lines  and 
the  total  network  utilization  is  minimized  as  is  the  communication 
cost,  and  the  network  resource  per  packet  investment.  The  third 
'real*  feature  which  contributes  to  network  performance  degradation 
is  communication  channel  distortion,  that  is,  line  noise.  A  simple 
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"back-cf-the  envelope”  calculation  illustrates  this  problem  and  the 
Min-Hop  contribution  to  the  solution.  Assume  a  path  *  ^  with  n 
links,  each  link  having  a  probability  of  error  (bit  error  rate)  of 
o.  Assume  also  that  the  link-level  protocol  will  detect  bit  errors 
and  require  retransmission  of  the  N-bit  packets.  It  is  easy  to 
show  [ U ]  that  the  average  number  of  transmissions  <T>,  required  per 
hop  per  packet  is. 


<T> 


(1  -  o  r 


>  i 


(3.3) 


for  a  >  6. 

The  average  number  of  transmissions  required  on  the  path 


v  ,  is, 
ab 

n<T>  =  - - — «  >  n  (3.M 

(1  -  o)N 

Clearly,  by  minimizing  n,  the  number  of  message  hops,  the  average 
number  of  transmissions  to  move  packets  from  network  sources  to 
network  destinations  is  also  minimized,  effectively  increasing 
system  efficiency  and  thruput. 

As  an  alternative  to  using  an  error  detect/correct  protocol 
and  requiring  message  retransmissions,  the  system  could  move 
messages  from  node  to  node  without  checking  for  errors.  In  that 
case,  as  a  message  progressed  through  the  network,  errors  would  be 
accumulated  along  the  message  path  until  it  reached  its  destination. 
Under  the  reasonable  assumpt*on  that  the  network  is  balanced  in 
terms  of  traffic  routing  and  communications  integrity,  the  total 
number  of  errors  in  a  received  message  will  be  directly  proportional 


to  the  message  path  length.  Thus,  to  minimize  overall  message 
distortion  throughout  the  network  the  average  message  path  should 
be  minimized  which,  of  course,  is  the  objective  of  the  Min-Hop 
strategy . 

In  the  following  section,  the  problem  formulation  for 
Min-Hop  routing  is  developed  and  a  method  for  calculation  of  the 
solution,  unconstrained  by  average  time  delay,  is  presented. 

3.2.2  D.P.  Approach  to 
Centralized 
Min-Hop 

A  fundamental  problem  in  the  design  of  message-switched 
telecommunication  networks  is  that  of  flow  assignment  and  routing 
[5-11].  Basically,  the  problem  consists  of  specifying  paths  for 
multicommodity  flow  between  all  sources  and  destinations  such  that 
some  suitable  measure  of  network  performance  is  optimized.  This 
flow  assignment  is  subject  to  conservation  of  total  average  flow 
at  each  node,  conservation  of  average  flow  commodity-by-commodity 
at  each  node,  and  to  link  capacity  constraints.  The  presentation 
is  as  follows.  First,  the  problem  formulation  and  the  development 
of  the  associated  recurrence  relation  is  presented.  Then  the 
solution  method  is  illustrated  via  a  six-node,  nine-link,  four- 
commodity  network  in  the  last  paragraph.  Consider  a  message- 
switched  network  with  N  nodes  and  M  directed  links  in  which 


message  lengths  are  independent  and  exponentially  distributed  with 
mean  1/p  bits,  and  the  network  message  arrival  processes  are 


73 


independent  and  Poisson.  Let  y  .  denote  the  average  rate  in 
messages  per  sec  at  which  traffic  enters  the  network  at  node  j 
destined  for  node  k,  J^k,  and  take  to  be  the  capacity  of  link  i 
in  bits/sec  and  the  average  total  flow  on  that  link  in 
messages/sec.  Finally,  it  is  assumed  that  the  interarrival  and 
transmission  times  on  each  link  are  independent  of  each  other . 

For  minimum  hop  flow  assignment,  the  function  to  be  minimized  is 

M 


J  .  !  I  A. 


(3 .5) 


where 


*  I 

J.k 


The  objective  function  is,  of  course,  the  average  path  length 

throughout  the  network  [10,  p.  327]  and  can  be  viewed  as  the 

sum  of  all  link-wise  network  traffic  or  as  the  sum  of  all  commodity- 

wise  traffic.  Consider  the  latter  and  let  r^fj.k)  be  the  message 

routing  variable  as  defined  in  Section  1.1*. 3-  For  each  (j,k) 

pair,  1*1,  ...,I  where  the  value  of  I,,  is  limited  by  the 
JK  JK 

network  topology,  but  may  be  selected  to  be  less  than  this  limit 
by  the  designer.  Nonnegativity  of  flow  and  conservation  of  flow 
require  that 


rt(j,k)  >  0 


(3.6a) 


and 


I  r  (J,k)  *  1 
l 


(3.6b) 


respectively,  for  all  £,J,k  in  Eq.  (3.6a)  and  for  each  (j,k)  pair  in 

Eq.  (3.6b).  Letting  n*  be  the  number  of  links  in  the  1th  shortest 

Jk 

(j,k)  path,  rewrite  Eq.  (3-5)  as 


J  *  -  [  Y,kr  (J,k)n* 

'  i,J,k  Jk  1  Jk 


(  .7) 


where  the  sum  over  £  includes  all  possible  paths  for  each  (J,k) 
commodity.  The  minimization  of  J  in  Eq.  (3.5)  is  subject  to  link 


capacity  constraints  which  are  specified  by 


0  <  A.  <  a.pC. 

l  i  i 


(3.8) 


where  0  <  <  1  and  i  =  1,  ...»  M.  This  has  the  effect  of  limiting 

the  average  utilization  pi  *  A^pC^  to  a  “aximum  of  for  each 

link,  a  feature  which  is  desirable  in  practice.  In  terms  of  the 

r  ( J  ,k )  and  n* ’  ,  the  set  of  constraints  defined  by  Eq.  (3-8)  can  be 
£  JK 


expressed  as 


(3.9) 


where  i=l,  ...,  M.  For  each  i,  the  summation  in  Eq.  (3-9)  is  over 
all  J,k,£  which  involve  flow  on  link  i.  Note  that  the  requirement 
A  0  is  automatically  satisfied  in  Eq.  (3.9)  since  r*(j,k)  >  0 
for  all  i,J,k,£.  The  problem  of  minimum  hop  flow  assignment  is  now 
seen  to  be  one  of  determining  the  set  of  routing  variables  rt(j,k) 
to  minimize  J  in  Eq.  (3-5)  subject  to  the  nonnegativity  and 
equality  constraints  in  Eq.  (3.6)  and  the  inequality  constraints  in 
Eq.  (3-9).  This  is  a  well-posed  linear  programming  problem  (2-15) 
which  can  be  solved  directly.  In  this  work,  however,  a  dynamic 


programming  approach  [16,17]  which  offers  certain  computational 
advantages  over  other  techniques  for  this  particular  problem  is 
developed . 


The  development  proceeds  by  first  forming  the  augmented 
performance  function. 


L  =  J  - 


I 


1*1 


r^(j,k)y 


Jk 


VCi 


(3.10) 


subject  to  the  M-m  constraints 

I  r^(j,kh  <o.uC  (3.11) 

i,  J  ,k,£  jk  i  i 

In  Eq.  (3-10),  J  is  given  by  Eq.  (3-7)  and  the  8^  are  Lagrange 
multipliers,  while  in  Eq.  (3.1l)»  i  *  m  +  1,  ....  M.  In  this 
formulation,  the  M  link  capacity  constraints  in  Eq.  (3.11)  are 
separated  into  two  sets  of  size  m  and  M-m,  respectively,  where 
0  ^  m  <  M.  The  value  of  m  partitions  the  solution  space  into  a 
routing  variable  space  and  a  Lagrange  multiplier  space. 
Computationally,  this  serves  to  trade  computer  memory  against 
repetitive  calculations.  Hence,  the  choice  of  m  may  be  governed 
by  available  computing  resources.  When  the  latter  is  not  an  issue, 
one  may  choose  is,  0  <  n  <  M,  as  a  matter  of  convenience. 

Referring  to  Eq.  (3.6b),  one  sees  that  the  dimensionality  of 
the  optimization  problem  can  be  reduced  by  an  amount  equal  to  the 
number  of  (j,k)  source-destination  pairs.  Namely,  one  can  set 


r  (J,k)  *  1  -  l  r  ( J ,k) 


(3.12) 
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for  some  a  for  each  (J,k)  paii  Since  the  choice  of  a  i6  arbitrary, 
without  loss  of  generality,  take  a  *  1  for  all  (j,k).  Substitution 
of  Eq.  (3.12)  into  Eq.  (3-7)  then  gives 

J  =  —  £  Y,.n^  ~  [  Y..  I  r(j,k)  n^. 

Yjtk  *  fa  >  pji!  pj’  J* 

+  7  l  Y,kr(j,k)n^. 


y  i.i.k  Jk  £ 


Y.1k  1 

Y  Jk 


\  “y~  ^njk  "  njk^r£^*k^  (3.13) 


£  »J  *k 
1*1 


By  using  x  ,  q  =  1,  — ,  W,  to  denote  the  routing  variables  r£(j,k) 
Q  x. 

over  all  £,J,k  with  i*l,  and  letting  a^  denote  the  corresponding 
coefficients 

¥  -  ■&> 

again  over  all  £,J,k  with  ij*l,  Eq.  (3.13)  can  be  written  as 


J  -  K  +  l 


(3.1M 


In  Eq.  (3.1M,  x  >0  and  the  value  of  W  is  the  number  of  routing 

q 

variables  in  the  original  problem  formulation  minus  the  number  of 
(j,k)  source-destination  pairs.  Also,  K  denotes  the  value  of  the 
first  term  on  the  right-hand  side  in  Eq.  (3.13).  Since  the  latter 
is  independent  of  the  routing  variables,  it  shall  be  ignored  in  the 
development  below. 

In  a  similar  fashion,  the  capacity  constraints  in  Eq.  (3.9) 
can  be  expressed  by  the  relation 
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w 

l  *ic  <  (3.15) 

q*i  q 

for  1=1,  ...»  M.  Here,  each  takes  on  the  appropriate  value  from 
the  set  {0,  i  y  .  }  and  each  c.  is  of  the  form 

jK  2 

v°’  •  £ 

in  accordance  with  the  substitution  ofl  Eq.  (3.12)  for  o*l  into 
Eq.  (3.5)  and  rearrangement  of  the  result  into  the  form  of 
Eq.  (3.15). 


As  a  result  of  Eqs.  (3.1M  and  (3.15),  the  reduced  dimension 
optimization  problem  is  that  of  determining  the  set  of  routing 
variables  x^,  q=l,  W,  and  the  set  of  Lagrange  multipliers, 

Bjp  1=1,  ...»  m,  to  minimize 


L* 


W 

I 


q=l 


ax 

q  q 


(3.16) 


subject  to  x 


q 


>  0  and 


V 


l 

q=l 


a.  x  < 
lq  q 


c. 

l 


(3.17) 


where  i  =  m+1,  _ ,  M.  It  is  a  direct  matter  to  show  that  this 

problem  satisfies  the  conditions  set  forth  in  [l8]  for  the  existence 
and  uniqueness  of  a  fixed  point  solution  for  a  global  minimum  in  J. 

From  the  dynamic  programing  view,  this  problem  is  one  of 
determining  a  sequence  of  functions  of  M-m  variables  together  with 
a  search  over  an  m-diroensional  Lagrange  multiplier  space.  The 
desired  recurrence  relation  follows  via  application  of  the  principle 
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of  optimality.  While  the  development  for  arbitrary  M  and  m  is 
straightforward,  it  is  lengthy  and  tedious,  and  will  not  be  given 
here.  Instead,  a  simple  example  is  presented  to  indicate  the 
dynamic  programming  approach,  and  then  the  general  recurrence 
relation  is  cited. 

Consider  the  case  where  M*l*  and  m=2  with  W  routing  variables. 
Using  Eq.  (3.l6)  the  recurrence  relation  is  defined  to  be 

f  s  s  si 


fs(c3’cU}  =  xr^.n,xs 

for  any  s,  1  <  s  <  W, 
x  >  0, 

q 


I  ax 

,  Q  Q 

q=i  4 


• 8l  X  -H'*  -  ,ii  **o> 


a,  .x  -  Bo  I  a„_x. 


(3.16) 

where  the  indicated  minimization  is  subject  to 


s 


V 

L 

q*i 


a_  x  < 

3q  q 


(3-19) 


and 


S  (3 

q=l  *  H 

Rewriting  the  relations  in  Equations  (3.18),  (3.19)  and 
(3.20)  as 


fs(c 


3’C1* 


)  = 


xs’xl»- 


min 
•  •  |X 


s-1 


a  q  -  6,  a,  x 
s  s  1  Is  s 


V 
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s— 1 

y  a,  x  <  c,  -  a.  x 
3q  9  3  3s  s 


and 


2-1 

y  a.  x  <  c,  -  a.  x 
Itq  q  «  «s  s 


respectively,  and  applying  the  principle  of  optimality,  yields 


fs(c3’cU)  =  “in 
*s 


a  x  -  y  6. a  x 
S  S  £  l  ts  E 


♦  f  ,(c_  -  a.  x  ,c.  -  a,  x  ) 
s— 1  3  3s  s  4  lis  s 


(3.21) 


which  is  subject  to  0  <  xg  <  min 


C3 


V  aUs 


Equation  (3.21)  is  the  desired  recurrence  relation  for  s-1,  W. 

Note  that  the  solutions  for  f  and  x  depend  upon  B,  and  B„  as  well 

s  s  i  2 

as  c^  and  c^.  The  solution  is  concluded  by  varying  the  Lagrange 
multipliers  B-^  and  8^  'to  satisfy  the  constraints 


W 


y  a.  x  <  c. 
_i  iq  q  i 


q=l 


for  i=l,  . . . ,  U, 

For  the  general  case,  the  dynamic  programming  recurrence 
relation  is 

r 

m 


f  (c)  =  min 


ax  -  y  B,,a4  x  +  f  ,  (c*) 
s  s  t  Is  e  s-1 


(3.22) 


for  s*l,  ...,  W  where  the  minimization  over  x  is  constrained  by 

s 


J 
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0  <  x  <  min 
s  i 

for  i*m+l,  . ..,  M.  Also  in  Eq.  (3.22),  c  and  c*  are  (M-m)- 

dimensional  vectors  whose  components  are  c.  and  c.  -  a.  x  . 

1  l  is  s 

respectively,  for  i=m+ 1,  M. 

The  solution  of  Eq.  (3-22)  yields  the  set  of  routine 
variables  xg  as  a  function  of  c  and  the  vector  6  «  (6^,  •  •*,  Bm)  of 
Lagrange  multipliers,  i.e.,  x£  *  xs(c,B)  for  s*l,  ...,  W.  The 
solution  is  completed  by  varying  the  Lagrange  multipliers  until  the 
set  of  constraints 


Vi 


I 

q=l 


a.  x 
iq  q 


where  i  *  1,  ....  M,  are  satisfied  (see  Eq.  (3-15)).  This  can  be 
done  using  any  appropriate  linear  search  technique.  Fibonacci 
search  [l6]  has  been  applied  to  a  number  of  examples  with  excellent 
results.  Along  with  Eq.  (3.12)  for  a=l,  this  yields  the  entire  set 
of  routing  variables  (r^J.k)}  for  minimum  hop  flow  assignment. 

The  above  procedure  was  applied-  to  the  network  shown  in 
Figure  3.2.  The  links  are  numbered  1  through  9  and  the  six  nodes 
are  labeled  a  through  f.  All  link  capacities  p(L,  i«l,  ...,  9,  are 
taken  to  be  5  messages/sec  with  *  0.8  for  all  i,  and  four 

commodities  are  specified  by  the  traffic  requirements  *  y&e  *  3 
and  y.  *  y..  *  2,  each  in  messages/sec.  The  possible  paths  and 

D6  QD 

1  2  1 

their  lengths  are  n  *  2  via  nodes  abc,  n  *  3  via  afdc,  n  *  2 

ftC  “C 

p  2  Q 

via  afe,  n  ■  3  via  af de ,  n  *  3  via  abce,  nf^  »  via  afdce, 

&e  ae  ne 


Figure  3.2  network  topology  for 
DP  Min-Hop  example 
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*  2  via  bee,  and  n^.  *  2  via  dab.  It  should  be  noted  that  two 
De  db 

of  the  ae  paths  have  the  same  length. 

The  total  number  of  routing  variables  is  eight:  r^(a,c), 
r2(a,c),  r1(a,e),  r^a.e),  r2(a,e),  r^Ca.e),  r^b.e),  and  r^d.b). 
However,  r^(b,e)  =  r^(d,b)  =  1  since  only  one  path  each  is  allowed 
for  (b,e)  and  (d,b)  traffic,  respectively.  Further,  from  Eq.  (3.12) 

r^(a,c )  *  1  -  r2(a,c)  (3.23) 

and 

r^(a,e)  *  1  -  r^a.e)  -  r2 
-  r3(a,e) 

Hence,  the  reduced  set  of  routing  variables  consists  of  the  four 
c.  1 

elements  r2(a,c),  r2(a,e),  r2(a,e),  and  r^Ca.e).  In  this  case, 

Eq.  (3.13)  is 

J  “  2  +  To  [r2U’c)  ♦  4(a’e) 

+  r2(a,e)  +  2r3(a,e)j 

Since  the  network  has  nine  links,  there  are  K  =  9  capacity 
constraints  in  the  form  of  Eq.  (3.15).  For  example, 

-r2(a,c)  +  r2(a,e)  <  ^ 

for  link  1  and 


for  link  6. 


rg(a,c)  K  i 
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Application  of  the  dynamic  problem  formulation  with  M=9  and  m*2 
provided  the  reduced  set  of  four  routing  variables.  Coupled  with 
the  single  path  routing  variables  for  (b,e)  and  (d,b)  traffic  and 
the  pair  of  constraints  in  Eq.  (3.23),  the  complete  set  of  routing 
variables  was  found  to  be 

r1(a,c)  =  0.667  r^( a,e)  =  1.0 

r2(a,c)  =  0.333  r2(a,e)  =  0 

r^(b,e)  =  1  r2(a,e)  =  0 

r^(d,b)  *  1  r^Ca.e)  *  0 

This  minimum  hop  flow  assignment  yields  J=2.1  as  the  minimum 
average  path  length  over  all  source-destination  pairs  for  this 
network.  The  choice  of  m=2  in  this  example  made  it  possible  to 
readily  implement  the  algorithm  on  an  HP  hlC  calculator. 
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the  first  part  having  been  developed  in  the  previous  section. 
After  presentation  of  the  algorithm,  the  results  are  illustrated 
via  a  network  example. 


The  problem  formulation  is  that  of  the  preceding  section. 
The  function  to  be  minimized  is  Eq.  (3.5)  subject  to  the  link 
capacity  constraints  of  Eq.  (3.8).  In  addition,  a  set  of 


is  imposed  upon  the  solution  set.  For  each  source-destination  pair 
(a,b)  of  interest,  Eq.  (3.2U)  defines  an  end-to-end  average  message 
delay  constraint.  Eq.  (3- 2U )  and  the  associated  message  routing 
variables  are  discussed  in  Section  l.U.3.  As  noted  earlier,  the 
solution  is  also  subject  to  conservation  of  total  average  flow  in 
the  and  also  in  the  individual  commodities.  The  algorithm  is  now 
described  in  two  parts.  Part  A  establishes  the  initial  feasible 
flow  and  Part  B  optimizes  the  initial  flow  to  satisfy  the  delay 
constraints  of  Eq.  (3.2U).  The  algorithm  is  as  follows: 
follows : 

A.  Initial  feasible  flow 

1.  Use  the  method  of  Section  3.2.2  to  establish  the 
initial  flow 


delay  constraint  (a,b).  (rJ^(j,k)  denotes  the 

zeroth  iteration  of  r^J.k)). 

2.  If  this  initial  flow  satisfies  the  end-to-end  delay 
constraints  in  Eq.  (3.2k),  stop.  Otherwise  proceed 
to  Part  B. 

Flow  Optimization 

1.  Given  f^n^  and  {r^n^(a,b)J  from  the  nth  iteration, 

l 

n  =  0,  1,...,  evaluate  the  left-hand  side  in 

E<j.  (3.2k)  for  each  (a,b)  pair  and  denote  the 

result  by  T'  . 

ao 

2.  For  each  which  violates  its  constraint,  choose 

the  second  shortest  path  (as  obtained  in  Part  A 

above)  and  deviate  hy^,  0  <  h  <  1,  onto  that  path 

to  form  T'  (h).  Choose  hE  (0,l)  so  that  T* 
ab  ab 

satisfies  its  constraint.  If  necessary,  deviate 
flow  onto  the  third  shortest  (a,b)  path  and  so  on 
until  the  constraint  is  satisfied,  or  the  set  of 
successive  shortest  (a,b)  paths  is  exhausted  and 
the  constraint  cannot  be  satisfied.  In  the  latter 
case,  terminate  the  process.  Otherwise,  proceed  to 
Step  3. 

3.  The  Xj  and  r^(a,b)  so  determined,  together  with 

those  unaffected  by  calculations  in  Step  2,  if  any, 
define  f^n+1*and  If  these  results 
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satisfy  all  end-to-end  delay  constraints,  atop. 

Otherwise,  return  to  Step  1  and  repeat  the  process. 

The  algorithm  was  applied  to  the  network  shown  in  Figure  3.3 

where  the  underlined  values  are  the  link  capacities  pC..  in 

messages/sec.  The  assumed  traffic  requirements  were  y^  =  yc(3  *  10, 

Ybh  =  Yeb  *  Yfb  *  Ygf  =  5»  and  Yca  *  1,  each  in  oessages/sec .  The 

end-to-end  average  delay  constraint  values  were  T  .  e  T  '  1.0  sec. 

&d  ca 

and  was  chosen  to  be  0.8  for  each  link,  except  for  link  cf  was 
set  to  0.9. 

« 

Part  A  of  the  algorithm  led  to  the  flow  assignment  given  in 

the  figure  by  the  first  number  in  parentheses  for  each  link.  The 

corresponding  routing  was 

>  .  :  8  via  aedb  Y  v:  5  via  edhb 

ab  2  via  afdhb  eb 


Y  , :  10  via  cfd 
cd 


Y^,:  5  via  fcgb 


Ybh  5  via  bdb 


Ygf:  5  via  ghf 


Y  :  1  via  cfa 
ca 


in  messages/sec,  the  average  path  length  was  n  =  J  *  2.537,  and  the 


two  end-to-end  average  delays  were  T'  *  l.lU  and  T  .  *  1.33  sec. 

AD  C<3 


Since  both  end-to-end  average  delay  constraints  were 
violated,  Part  B  of  the  algorithm  was  employed  to  satisfy  the 
constraints.  The  resulting  flow  assignment  is  given  in  the  figure 
by  the  second  number  in  parentheses  for  each  link,  and  the 
associated  routing  is 
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Figure  3.3  Network  example  for  centralized  Min-Hop  algorithm 
constrained  by  average  end-to-end  message  delay 
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Y  .  :  7.73  via  aedb  y  :  5  via  edhb 
a  2.27  via  afdhb 

y-:  5  via  fcgb 

Y  9.6l  via  cfd 

C  0.39  via  cgbd  y  :  5  via  gbf 

y,.:  5  via  bdh  Y  :  1  via  cfa 

on  ca 

The  average  path  length  increased  slightly  to  n  *  J  *  2.573  and  the 

two  constraints  were  satisfied  to  two  decimal  places,  namely, 

TV  =  T'.  =  1-00  sec. 
ab  cd 

The  algorithm  converged  in  one  pass  through  Part  A  and  two 
iterations  in  Part  B,  the  stopping  condition  for  the  latter  being 
satisfaction  of  the  end-to-end  delay  constraints  to  two  decimal 
places.  No  attempt  was  made  to  optimize  the  algorithm  in  any  sense. 
The  calculations  required  in  Step  3  of  Part  A  and  in  Step  2  of 
Part  B  were  done  via  a  direct  search. 


3.2.1*  Decentralized  Min-Hop 
Strategy 

In  the  preceding  sections  a  theory  and  procedure  for 
constrained  Minimum  Hop  routing  has  been  developed  for  use  in 
large-scale,  data-communication  networks.  The  concern  of  this 
section  is  with  achieving  the  same  result  employing  a  distributed 


algorithm  which  is  implemented  nodewise  over  the  entire  network 


with  each  node  requiring  information  only  from  its  adjacent 
neighboring  nodes.  The  approach  taken  for  this  problem  is  funda¬ 


mentally  different  from  that  used  for  the  centralized  problem  in 
[1,2],  there  being  no  readily  apparent  extension  or  modification 


of  the  latter  to  the  distributed  routing  problem. 


The  organization  of  this  section  is  as  follows.  First,  the 
constrained  Min-Hop  routing  problem  is  formulated  from  the 
perspective  of  distributed  computations  with  "nearest-neighbor"  (or 
"adjacent")  information.  A  two-part  algorithm  is  then  developed  in 
which  the  first  part  provides  unconstrained,  alternate  path. 

Minimum  Hop  routing  and  the  second  part  adjusts  this  routing  to 
satisfy  the  end-to-end  average  message  delay  constraints.  The 
section  concludes  with  an  example  to  illustrate  the  algorithm. 

The  methodology  which  was  developed  in  [8]  for  distributed 
minimum  average  delay  routing  in  acyclic  networks  is  followed  in 
part.  Consider  a  message-switched  network  with  N  nodes  and  M 
directed  links  in  which  message  lengths  are  independent  and  expo¬ 
nentially  distributed,  and  network  message  arrival  processes  are 
independent  and  Poisson.  Denote  by  the  average  rate  in 
messages/sec  at  which  traffic  enters  the  network  at  node  i  destined 
for  node  k,  and  take  *  0  for  all  i  *  k. 

In  general,  i,  J,  and  k  denote  nodes,  and  whether  they 
refer  to  source,  destination  or  intermediate  nodes  will  be  clear 
from  context  as  was  the  case  above.  With  this  in  mind,  let  be 
the  capacity  in  messages/sec,  of  the  directed  link  (i,J)  from  any 
node  i  to  any  node  J,  i  +  J.  Similarly,  use  A^j,  i  +  J ,  to 
specify  the  average  total  flow  on  link  (i,j)  in  roessages/sec .  Let 
u^k),  i  t  J  and  i  i  k,  denote  the  component  of  A^  whose 
destination  is  node  k.  Finally,  let  rR(i,k)  be  the  routing  variable 
for  (i,k)  source-destination  traffic  on  the  nth  shortest  (i,k) 
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path.  In  connection  with  the  latter,  it  is  assuaed  that  there  is  at 
least  one  directed,  loop- free  path  from  node  i  to  node  k,  where  by 
the  term  loop-free  it  is  meant  that  no  node  is  encountered  more 
than  once  in  traversing  the  path.  In  fact,  all  allowable  source- 
destination  paths  are  loop-free  in  this  sense,  and  the  network  is 
accordingly  acyclic  in  its  flow. 

The  global  problem  is  to  minimize  the  average  path 
length  [10] 

l3-25) 


with  respect  to  the  set  of  routing  variables  {rn(i,k)).  In 
Eq.  (3-25),  the  summation  is  over  all  M  links  in  the  network  and 


«  I  > 

i,k 


ik 


where  the  latter  summation  is  over  all  (i,k)  source-destination 
node  pairs.  The  minimization  with  respect  to  the  r^fi.k)  is  over 
all  (i,k)  source-destination  node  pairs  where  n  indexes  the  paths 
from  shortest  to  longest  in  terms  of  the  number  of  links  in  each 
for  each  i,k. 

The  above  minimization  is  subject  to  a  set  of  one  or  more 
end-to-end  average  message  delay  constraints 

rt(a,b) 


<  7 

,  C.  -  A. ,  ab 
ex  ^  ij  ij 


(3.26) 


ab 


For  each  (a,b)  source-destination  node  pair  of  interest  in 


Eq.  (3.26),  T&t  is  fixed,  x^  is  the  set  of  all  links  (i,j)  which 


are  involved  in  carrying  traffic  from  node  a  to  node  b,  w  .  the  set 

ab 


involved  in  the  tth  shortest  path,  and  the  r£(a,b)  depend  upon  the 
routing  assignment. 

In  addition  to  the  constraint  set  specified  by  Eq.  (3.26), 
the  minimization  of  J  in  Eq.  (3.25)  is  subject  to  conservation  of 


total  average  flow  in  the  A. .  and  also  in  the  individual 

^  J 


commodities.  With  respect  to  the  former,  the  requirement  is  that 


0  K  A.  <  C.  for  all  (i,j)  links.  This  is  handled  in  the  algorithm 
i  J  i  J 


via  the  strict  inequality  constraint  0  <  A.  <  n. ,C  where 

1  1  J  1  J 


0  <  n.  <  1,  which  has  the  effect  of  limiting  the  average  utili- 


'ij 


zation  p.,  =  A. ,/C. ,  to  no  more  than  n. .  for  each  link, 
i  J  i  J  i  J  i  J 


The  remaining  constraints  are  those  imposed  by  nonnegativity 
and  conservation  of  flow  on  the  routing  variables.  These  lead, 
respectively,  to  the  relations 


rJl(i,k)  >  0 


(3.27a) 


and 

l  r  (i,k)  *  1  (3.27b) 

«  1 

for  all  i,  i,  k  in  Eq.  (3.27a)  and  for  each  (i,k)  pair  in 
Eq.  (3.27b). 

The  development  of  this  approach  begins  by  noting  that  since 
the  network  is  acyclic  in  its  flow,  it  can  be  depicted  as  shown  in 
Figure  3.1»  using  virtual  node  splitting  where  necessary.  In  the 
figure,  the  nodes  are  grouped  as  shown  and  indexed  from  1  to  S, 


right-to-left .  All  nodes  in  Group  1  are  destination  nodes,  while 
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those  in  Groups  2  through  S-l  may  be  source  and/or  destination 
and/or  switching  nodes.  Nodes  in  Group  S  are  all  source  nodes. 

As  a  result  of  the  structure  in  Figure  3.1*,  a  natural 
nodevise  decomposition  of  the  network  is  that  given  in  Figure  3.5 
for  a  representative  node  i  where  the  adjacent  upstream  nodes  are 
indexed  by  m,  the  adjacent  downstream  nodes  by  J,  and  the  downstream 
destination  nodes  by  k.  For  purposes  of  the  algorithm  given  below, 
it  is  necessary  to  assume  that  the  adjacent  downstream  nodes  {j) 
can  communicate  with  node  i  for  purposes  of  routing  information 
exchange . 

Step  1  of  the  algorithm  is  a  distributed  procedure  for 
determining  all  source-destination  paths  and  their  respective 
lengths.  To  determine  the  paths  and  their  lengths,  let  i*k, 

k  a  destination  node,  and  i  any  node  in  Groups  2  through  S  in 
Figure  3-1*}  be  the  set  of  all  (i,k)  paths  in  the  network.  Then 
define  path  length  by 


'  .1  *n 
£  ev., 
n  lk 


(3.29: 


where  i  ^  j  and  J  ranges  over  the  set  of  adjacent  nodes  downstream 

from  node  i  as  indicated  in  Figure  3.5.  In  Eq.  (3.28),  i  ranges 

over  all  nodes  in  each  group,  but  calculations  for  each  i  in  a 

group  are  independent  of  those  at  all  other  nodes  in  the  group. 

Also,  a. ,(j)  *  1,  i  +  J,  and  n  ranges  over  with  t  *  1  for 
lj  ik  n 


each  link. 
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The  process  of  determining  the  a^(k)  begins  in  Group  2  and 
sweeps,  synchronously  or  asynchronously,  from  right  to  left, 
terminating  at  Group  S  (see  Figure  3.*0.  At  this  point,  each 
source  node  in  the  network  knows  its  set  of  (i,k)  source-destination 
paths  and  their  respective  lengths. 

Step  2  of  the  algorithm  assigns  the  routing  variables 
(r.(i,k)}  for  the  entire  network.  For  the  minimum  o.  (k),  i  a 

*•  lj 

source  node,  r^Ujk)  is  assigned  to  the  link  (i,j).  For  the  next 

largest  a^k),  r2(i,k)  is  assigned  in  the  same  way,  and  the 

procedure  continues  at  each  i  until  the  set  of  a  (k)  is  exhausted. 

This  process  begins  at  the  nodes  in  Group  S  in  Figure  3-1*  and  moves 

stepwise  left  to  right  until  it  reaches  Group  2  at  which  point  all 

possible  ra(i,k)  are  now  indexed  to  the  appropriate  outbound  links 

of  all  source  and  intermediate  nodes. 

Step  3  involves  the  assignment  of  the  u^(k)  over  the 
entire  network  to  minimize  the  average  path  length  subject  to  the 
capacity  constraints  and  the  conservation  of  flow.  Owing  to  the 
nodewise  decomposition  in  Figure  3.5,  the  global  optimization 
problem  specified  by  Eq.  (3.25)  simplifies  to  the  following  linear 
programming  subproblem  at  each  node  i : 

min  7  a.  (k)u.  (k)  (3.29) 

{UiJ(k)>0)  J,k  1<3 

subject  to 

|  <  nljCiJ  (3.30) 


I 


I  *  I  u^(k^  +  y< 


(3.31) 


Calaulations  commence  at  the  nodes  in  Group  S  in  Figure  3.**  and 

move  to  the  right,  terminating  at  the  nodes  in  Group  2.  The 

information  exchange  required  consists  of  the  u  .(k)  being  provided 

mi 

to  node  i  from  the  calculations  carried  out  at  the  adjacent  upstream 
nodes  {m>  (see  Figures  3.1*  and  3-5). 

Determination  of  the  routing  variables  now  follows 
immediately.  Starting  at  a  source  node  i,  the  routing  variable 
r£(i,k)  for  the  Ith  shortest  (i,k)  path  is 


u.  (k) 

r«(1-k)  ■ 


(3.32) 


Again,  the  procedure  sweeps  from  left  to  right,  terminating  at 
Group  2. 

This  completes  the  first  part  of  the  algorithm  wherein  the 
minimum  hop  routing  has  been  achieved  subject  to  flow  conservation 
and  link  capacity  constraints.  The  next  and  final  task  is  to  adjust 
this  routing  to  satisfy  the  set  of  end-to-end  average  delay 
constraints  which  are  specified  by  Eq.  (3.25). 

Step  U  of  the  algorithm  requires  that  the  source  nodes 
(a)  calculate  their  respective  which  result  from  the  routing 

assignment  in  Step  3  above,  and  compare  them  with  the  specified 
{T^}.  This  is  done  termwise  for  all  a,b  source-destination  pairs 
via  a  sweep  from  right  to  left  beginning  at  Group  2  in  Figure  3.1* 
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and  terminating  at  Group  S  using  the  left-hand  side  in  Eq.  (3.25). 

If  the  result  is  that  <  Tab  for  all  (a,b),  the  process 
terminates.  If  not,  proceed  to  the  next  step. 

Step  5  pertains  to  all  nodes  i  which  are  involved  in  the 
routing  of  (a,b)  traffic  wherein  >  T  .  Referring  to  Figure  3.5, 

solve  the  following  nonlinear  programming  subproblem: 


min  l  C  (k)u.  (k) 

(u  (k)  >0)  J,k  iJ 


(3.33) 


subject  to 


I  u  (k)  <  n,,  C 


ij 


U  iJ 


(3.3*0 


and 


|uij(k)  -  l  V0 

J  ® 

k^l 


(3-35) 


The  analogy  to  the  subproblem  specified  by  Eqs.  (3. 29),  (3-30)  and 
(3.31)  is  clear.  However,  the  path  length  metric  here  is  that  of 
average  link  delay.  In  particular,  the  c^(k)  in  Eq.  (3-33)  are 
defined  by 


‘ ,  L  *■ 

n  lk 


(3.36) 


where 


r(i.k) 

t  =  _S - 

"  Cij  '  Xij 


(3.37) 


and  is  the  same  as  in  Eq.  (3-28).  In  Eq.  (3-37),  the  values  of 

r  (i,k)  and  A.,  which  are  used  to  evaluate  l  are  those  obtained  in 
n  ij  n 

the  first  part  of  the  algorithm. 
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Determination  of  the  j (k )  proceeds  In  the  aaae  fashion  as 
that  given  for  the  a^k)  in  Step  1  except  that  the  link  length  is 
now  given  by  Eq.  (3. 37). 

Solution  of  the  subproblems  specified  Dy  Eqs.  (3-33),  (3.3-). 
and  (3-35)  concaences  at  Group  S  and  moves  to  Group  2.  The  process, 
however,  is  carried  out  only  at  those  nodes  which  participate  in 
end-to-end  delay  constraint  violations. 

Finally,  the  new  end-to-end  delay  constraints  are  calculated 
and  compared  with  the  specified  ones.  At  this  point,  the  algorithm 
has  either  satisfied  all  end-to-end  delay  constraints  or  found  that 
one  or  more  of  them  cannot  be  met.  This  concludes  the  algorithm. 
However,  it  should  be  noted  that  the  solution  procedure  for  the 
second  part  of  the  algorithm  is  heuristic.  It  should  be  clear  that 
this  second  part  is  suboptiraal  in  the  sense  that  J  in  Eq.  (3.25)  is 
not  minimized  over  the  entire  network  in  satisfying  the  delay 
constraints.  On  the  other  hand,  its  virtue  resides  in  its  simple 
implementation  which  is  attractive  for  applications.^ 

The  above  algorithm  was  used  to  solve  the  constrained 

minimum  hop  routing  problem  for  the  network  shown  in  Figure  3.6 

where  the  underlined  values  are  the  link  capacities  in  messages/sec. 

«s 

The  assumed  traffic  requirements  were  *  *cd  “  10‘  Ybh  *  *eb  = 

*  y  j  *  5,  and  y ca  *  1,  each  in  messages/sec.  There  are  thus 
7  commodities.  The  end-to-end  average  message  delay  constraints 
were  taken  to  be  T&b  *  Tc(J  *  1.0  sec,  and  we  set  *  0.8  for  each 
link  with  the  exception  of  ncj.  *  0.9* 
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e 


Figure  3-6  The  network  example  employed  to  illustrate 
the  decentralized  Min-Hop  algorithm 
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Solution  of  this  same  network  routing  problem  via  the 
centralized  algorithm  in  Ilj  gave  exactly  the  same  results  for  the 
unconstrained  minimum  hop  part.  However,  the  centralized 
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algorithm,  which  is  known  to  be  optimal  for  both  parts,  led  to  a 
slightly  different  routing  in  satisfying  the  constraints  and  gave 
J  *  2. 573  links.  While  the  difference  is  not  significant  for  this 
example,  it  could  be  for  others  and  points  to  the  need,  noted 
earlier,  for  an  exact  distributed  algorithm  to  satisfy  the  delay 
constraints . 

3.3  Path  Rate  Distortion 
Equalization  (PRDE) 

Strategy’ 

The  PRDE  strategy  is  to  set  the  effective  link  capacity 
Ci/R1(D1)  equal  to  a  constant  C  for  all  links  in  the  network.  The 
objective  of  this  strategy,  then,  is  to  balance  the  link  capacities 
throughout  the  network.  This  is  similar  in  concept  to  the  load¬ 
leveling  strategies  employed  in  multiple  processor  environments, 
telecommunication  systems,  and  multiple  disk  string  management. 

The  primary  consequence  of  the  strategy  is  to  allow  for  a 
simple  capacity  assignment  methodology  as  will  be  shown  in  the 
following  paragraphs.  The  development  of  this  section  is  as 
follows.  First,  a  brief  overview  of  an  implementation  scheme  for 
this  strategy  is  presented.  The  section  then  concludes  with  a 
mathematical  development  of  capacity  assignment  under  the  FRDE 
strategy . 

Perhaps  the  simplest  method  for  network  level  implementation 
of  the  PRDE  policy  is  the  use  of  identical  communication  links 
throughout  the  network,  e.g.,  conditioned  9^00  baud  land-lines. 


Identical  communication  links  guarantee  that,  in  the  presence  of 
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identical  switching  processors  and  balanced  message  flows  with 
identical  source  message  probabilities,  that  the  rate  distortion 
functions  R1(D1)  are  identical.  This  assumption  would,  in  practice, 
be  valid  for  many  electronic  mail  systems  and  local  area  networks. 

On  the  other  hand,  the  assumption  would  be  invalid  for  shared 
resource  networks  servicing  diverse  users,  e.g.,  lymnet.  A 
particularly  promising  test  bed  for  this  strategy  would  be  a  local- 
area  electronic  mail  network. 

One  of  the  more  difficult  network  design  problems  is  the 
optimum  selection  of  link  capacities.  In  a  network  employing  PP.DE, 
the  capacity  assignment  is  simplified.  For  this  problem,  the 
network  model  of  Section  3.2.2  is  invoked  and  the  solution 
methodology  is,  in  part,  developed  in  (Chapter  5,  10].  The  capacity 
assignment  is  solved  for  a  fixed  network  topology  and  known  traffic- 
flow  {1^}.  The  objective  of  the  solution  is  to  choose  the  link 
capacities  (C^)  so  as  to  minimire  the  average  message  delay  T 
subject  to  a  linear  capacity  cost  S.  The  form  for  T  is  given  in 
Eq.  (1.25).  The  linear  capacity  costs  are 


M 

S  «  I  d 

i*l 

where  dA  is  the  cost  for  each  unit 
link.  The  solution  involves  using 
the  augmented  function 


R1 ( D* ) 


(3-38) 


of  effective  capacity  in  the  ith 
Lagrange  multipliers.  Forming 


L  -  T  «•  8 


R* (D1 ) 


S 


(3.39) 


where  41  is  the  undetermined  Lagrange  multiplier  and  taking  the 
derivative  with  respect  to  effective  capacity  (C^/R^D*)},  yields 
the  following  set  of  equations 


9L 

ac. 

1 


for  i  =  1,2, . . .M. 

Simplification  of  Eq.  (3.1*0)  gives 


(3.1*0) 


C. 

1 


r'CD1) 


X.  , 

-i  +  _L_ 
y 


M2 


d. 

1 


(3.1*1) 


for  i  =  1 ,2, . . .M. 

The  Lagrange  multiplier  g  in  Eq.  (3.1*1)  is  evaluated  by 
multiplying  Eq.  (3.1*1)  by  di  and  summing  on  i.  The  optimal  capacity 
assignment  under  the  PRDE  policy  is  then  found  to  be 


C.  «  P^D1)  (  —  + 


(*  -  .1,  -V- 


/x7d7 

1  1 


d. 

1 


M 

3=1  J  J 


)  (3.1*2) 


As  can  be  seen  from  Eq.  (3.1*2)  the  optimal  capacity  assignment  for 
minimizing  average  message  delay  is  dependent  on  link  flow,  average 
message  length,  cost  criteria,  and  the  link  rate  distortion 
function.  The  implementation  of  PRDE  can  now  take  place  by  either 


choosing  the  desired  message  distortion  and  then  calculating  the 
link  capacity  using  Eq.  (3.1*2)  or  assuming  a  constant  effective 
capacity  C  for  all  links  and  choosing  both  link  capacity  and 
message  distortion.  In  the  latter  technique,  if  the  constant  C, 
the  link  capacity  C^,  and  the  distortion  D^,  are  properly  chosen 


10* 

such  that  Eq.  (3.U2)  is  valid  for  all  links,  then  the  PRDE  policy 
will  lead  to  the  minimum  average  message  delay. 

3-*  Path  Rate  Prioritization 
(PRDF)  Strategy 

As  noted  in  Chapter  2,  the  objective  of  this  policy  is  to 
give  selected  commodities  preference  over  other  commodities  by 
maximizing  C^/R^CD)  for  some  (J,k)  pairs.  The  consequences  of 
this  policy  depend  on  the  method  of  implementation.  In  the 
following  paragraphs,  two  implementation  schemes  will  be  outlined 
and  their  associated  consequences  discussed.  In  the  first  imple¬ 
mentation  scheme,  let  C^/R^D)  be  maximized  by  allowing  increased 
message  distortion  D.  There  are  two  effects:  first,  obviously,  the 
(j,k)  message  traffic  will  be  degraded,  i.e.,  contain  more  errors, 
second,  the  channel  queueing  delay  will  be  reduced.  The  former 
effect  will  not  be  acceptable  if  higher  priority  messages  are  also 
intended  to  be  low  distortion  messages.  The  latter  effect,  which  is 
quantified  in  Chapter  U,  is,  in  general,  desireable.  Finally,  this 
scheme  would  be  relatively  easy  to  implement  in  a  large-scale 
network,  although  it  may  not  be  optimal  from  a  data  integrity 
viewpoint . 

The  second  implementation  policy  makes  use  of  the  set  of 
path  capacities  C^.  By  upgrading  the  links  involved  in  the 
priority  traffic,  message  delay  will  be  decreased  without  sacri¬ 
ficing  message  integrity.  This  approach,  in  fact,  is  commonly  used 
in  systems  such  as  AUT0V0N  where  high-quality  communications  are 
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desired  vith  a  minimum  of  message  delay.  The  penalty  for  this 
approach,  of  course,  is  in  the  higher  costs  incurred  in  the 
operation  of  high  capacity  links.  In  general,  such  a  policy  could 
only  be  pursued  to  meet  special  user  requirements. 

3. 5  Conclusion 

In  this  chapter,  three  routing  strategies  which  are  relevent 
to  the  modeling  of  data-communications  networks  via  information- 
theoretic  methodologies  have  been  presented.  The  focus  of  the 
chapter  was  on  the  Minimum-Hop  routing  strate^  because: 

1.  The  strategy  optimized  an  important  performance  metric. 

2.  The  strategy  could  be  used  with  end-to-end  message 
delay  constraints. 

3.  The  strategy  could  be  implemented  in  either  a 
centralized  or  distributed  fashion. 

In  addition  to  the  Min-Hop  routing  strategy,  two  other  strategies 
were  presented.  In  particular,  the  capacity  assignment  under  PRDE 
was  developed  and  presented,  and  the  limitations  of  PRDP  were 
presented. 

From  the  research  contained  in  this  chapter  certain 
intriguing  questions  become  apparent  and  offer  themselves  as 
directions  for  future  investigations.  These  questions  will  be 
addressed  in  Chapter  5- 
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Chapter  1* 


ADDITIONAL  COMPUTATIONAL  RESULTS 

L.l  Introduction  to  Chapter  h 

In  this  chapter,  the  theory  developed  in  Chapters  2  and  3  is 
applied  to  a  link  example  and  a  network  example  to  provide  illus¬ 
trations  of  key  results.  In  Section  U.2,  a  generalized  information- 
theoretic  calculation  of  link  capacity  C^  is  presented.  Also  in 
Section  U.2,  the  distortion  measures  introduced  in  Chapter  2  are 
used  to  calculate  the  link  rate  distortion  functions  R^(Di).  In 
Section  L. 3,  the  average  link  queueing  delay  (X.^ ,C^ ,RX (D1 ) )  is 
calculated  and  displayed  for  a  typical  link  as  a  function  of 
normalized  distortion  D^  and  message  rate  ^  under  various 
distortion  measures.  Section  U.L  illustrates,  via  a  network 
example,  key  results  in  the  implementation  of  path  level  rate 
distortion.  The  average  end-to-end  delay  of  a  single  commodity, 
an  upper  bound  for  the  average  end-to-end  delay,  and  the  average 
message  delay  for  all  commodities  is  calculated  and  presented  as  a 
function  of  message  corruption.  The  chapter  concludes  with 
Section  U.5  and  a  best  case-worst  case  comparison  of  delay  as  a 
function  of  distortion. 

L.2  R*(D*)  for  Eight  Distortion 

Measures 

In  Chapter  2,  four  basic  context-free  distortion  metrics 
and  their  associated  normalized  forms  have  been  proposed  as 


measures  for  the  costs  of  message  corruption.  Briefly 
recapitulating,  metrics  1  and  2  measure  message  errors  from  a 
bit-level  perspective,  with  and  without  an  attached  message 
priority,  respectively.  Metrics  3  and  U  assign  distortion  costs 
from  a  character- level  perspective,  again  with  and  without  attached 
message  priority,  respectively.  The  normalized  forms  of  the  four 
basic  distortion  measures  have  been  introduced  to  facilitate  network 
design  and  provide  a  basis  for  performance  comparisons.  These 
eight  distortion  measures  are  used  in  the  calculation  of  the  link 
rate  distortion  function  Ri(D^). 

The  link  rate  distortion  function,  defined  in  Eq.  (2.35),  is 
a  convex  linear  programming  problem  subject  to  both  equality  and 
inequality  constraints.  An  iterative  algorithm  due  to  Blahut  and 
described  in  [l]  may  be  used  to  solve  the  problem  for  general 
distortion  measures  and  message  input  probabilities  {P*(j,k)J. 
Analytical  techniques  for  the  calculation  of  (D1 )  are  described 
in  [1-3].  These  techniques  generally  exploit  symmetry  properties 
in  the  message  probability  distributions  or  in  the  matrix  of 
distortion  metrics.  For  the  examples  of  this  section,  the  compu¬ 
tational  technique  introduced  in  [2]  and  elaborated  on  in  [3]  was 
utilized. 

To  illustrate  the  differences  in  the  proposed  distortion 
measures,  assume  that  in  the  network  for  this  example  it  i6  desired 
to  transmit  256  binary  coded  messages.  Further,  assume  that  in 
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this  network  the  256  messages  are  all  equally  likely  to  be 
transmitted  by  the  individual  users,  i.e., 

Ps(j’k)  =  25S  (la) 

for  all  i,  s,  and  (j,k)  pairs.  In  addition,  the  network  character 
code  is  comprised  of  1*  bit  words,  e.g.,  a  l6-bit  message  is  made  up 
of  1*  characters.  Before  the  distortion  measures  can  be  quantified 
further,  it  is  necessary  to  calculate  the  required  message  length  in 
bits.  Intuitively,  one  sees  that  under  binary  coding,  256  equally 
likely  messages  can  be  obtained  using  8  bits,  because 

2®  =  256 

However,  the  same  result  can  be  obtained  from  an  application 
of  Eq.  (2.1*9),  as  the  following  calculation  quickly  shows.  Let  each 
link  in  the  example  network  be  a  binary-symmetric  memoryless 
channel.  Then  for  the  symmetric  discrete  memoryless  channel  ( DMC ) 
with  N  output  messages  and  N  input  messages  and  transition 


probabilities  given  by 


♦«<*-«„> 


where  6  is  the  Kronecker  delta  function,  the  capacity  as  defined 
by  Eq.  (2.1*9)  becomes 


Ci  =  log  N  -  H(e)  bits/channel  usage 


(1*.3) 


where  for  binary  coding  log  N  is  to  base  2  and  H(»)  is  the  usual 
entropy  function.  For  a  distortionless  channel  e  *  0  and  H(0)  *  0 
so  that  Eq.  (U.3)  becomes 

C.  *  log  N  «  log  256  *  8  bits/channel  usage 


(1*.M 
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(The  above  result  for  N  messages  is  an  extension  of  the  binary 
channel  developed  in  [•<].) 

Using  the  above  result,  the  distortion  measures  will 
be  of  the  form, 

d(m,z)=^-dm  +  P  (^.5) 

for  the  binary  level,  and 

d(m,z)  *  Uc  +  P  (U.6) 

2  m 

for  the  character  level.  For  the  binary  level  calculation,  d  will 
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range  from  0,  for  messages  received  without  errors,  to  8  for 

messages  which  have  8  errors.  For  the  character  level  measure,  the 

range  is  from  0  to  2  corresponding  to  the  message  with  no  errors  to 

a  message  with  2  character  errors.  (Note  that  denotes  the 

normalized  distortion.  F1(D1)  will  be  used  to  denote  the  rate 

distortion  function  with  distortion  D1  or  D?l.  The  correct 

N 

distortion  measure  is  clear  from  the  context  in  which  R  (D*)  is 
used. ) 

Under  the  above  assumptions  and  conditions,  the  link  rate 
distortion  functions  have  been  calculated  and  are  shown  in 
Figures  4.1  thru  Figure  4.8.  In  Figures  4.1  and  4.2  the  unnor¬ 
malized  and  normalized  binary  level  Hamming  distance  measure  with 
no  message  priority  was  used.  Note  that  R*(D*)  has  the  classical 
shape  of  the  binary  symmetric  channel  of  capacity  *  1/2. 

Figure  4.3  shows  R*(D*)  for  the  unnormalized  binary  level  measure 
with  message  priority  P  *  2.  The  normalized  curve  is  shown  in 

■  '  / 
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Figure  The  use  of  message  priority  has  had  the  desired  effect 

of  increasing  R1(Di),  over  the  range  0  <  D*  <  1,  compared  with  the 
curve  of  Figure  h.2.  Figure  1.5  and  Figure  U.6  show  the  results 
for  the  character  level  metric  with  no  message  priority,  unnor¬ 
malized  and  normalized  curves,  respectively.  Comparing  the  R^D*) 
for  the  character  level  measure  with  the  Ri(D^')  for  the  binary 
level  measure,  one  sees  that  the  character  level  measure  leads  to 
higher  required  message  rates  for  equivalent  distortion  in  the 
range  [0,l].  This  is  a  somewhat  surprising  result  which  may  have  a 
bearing  on  the  issue  of  bit-oriented  versus  character-oriented 
protocols.  Using  the  character  level  metric  with  message  priority 
P  *  2,  the  unnormali2ed  and  normalized  R^(Di)  are  shown  in 
Figure  h.7  and  Figure  4.8,  respectively.  Again,  the  use  of  message 
priority  has  had  the  desired  effect  of  increasing  R1(Di)  over  the 
range  0  <  D*  <  i . 

In  summary,  the  curves  of  R^D1)  presented  in  this  section 
provide  evidence  for  the  following  conclusions: 

1.  The  use  of  message  priority  in  the  distortion  measure 
will  act  to  decrease  effective  link  capacity  and  increase  message 
fidelity. 

2.  The  character  level  measure  does  not  offer  effective 
link  capacity  improvements  over  the  binary  level  measure.  This 
result  may  have  a  bearing  on  the  performance  analysis  of 
bit-oriented  and  character-oriented  computer-communication 


protocols . 


distortion  D 


Figure  U.l  The  unnonnalised  link  rate  distortion  function  F1(D1) 
for  the  binary  level  distortion  measure  with  message 
priority  P  *  0 


distortion 

Figure  1*.2  The  normalized  link  rate  distortion  function  Fi(Di) 
for  the  binary  level  distortion  measure  with  message 
priority  P  *  0 


u 


0-6 


0.8 


1.0 


0. 


distortion 


,  ,tnv  distortion 

ority  P  *  0 


123 


message  priority  P  *  2 


125 


X^  =  100  msgs/sec 


Figure  U.13  Link  delay  T.  as  a  function  of  link  distortion  DN 
for  the  character  level  distortion  measure  with 
priority  P  =  0 
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Dx  *  0.00 
D2  =  0.20 

d3  =  0.1*0 


Figure  U.l6  Link  delay  as  a  function  of  link  message  rate  X. 

for  the  normalized  character  level  distortion 
measure  with  message  priority  P  *  2 


In  the  next  section,  the  network  performance  vis-£-vis 


message  delay  will  be  examined  as  a  function  of  message  fidelity. 

U .3  Link  Delay  as  a  Function 
of  Distortion  and 
Message  Rate 

In  this  section,  the  link  delay  is  calculated  for  the 
distortion  measures  introduced  in  Chapter  2.  The  results  are 
presented  in  graphical  form  with  link  delay  as  a  function  of 
normalized  distortion  or  message  rate  X^ .  For  all  cases,  the 
normalized  link  distortion  was  used  to  facilitate  performance 
comparisons.  For  the  purposes  of  these  numerical  calculations,  it 
is  assumed  that  the  link  capacity  is 

C^  *  2l*00  bits/sec  (bps) 

This  refers  to  the  standard  capacity  which  is  considered  to 
be  the  upper  limit  for  distortionless  transmission.  The  equivalent 
message  rate,  using  the  problem  formulation  and  results  of  the 
preceding  section,  is  300  msgs/sec.  At  a  message  rate  X^  of 
300  msgs/sec  the  classical  queueing-theoretic  model  would  lead  to 
infinite  link  delays.  As  noted  in  Chapter  2,  and  illustrated  in 
this  section,  by  allowing  message  distortion,  it  is  possible  to 
transmit  at  rates  greater  than  300  msgs/sec  and  maintain  finite 
link  delays. 

In  Figure  U.9,  the  link  delay  has  been  calculated  using 
Eq.  (2.7M  and  the  binary  level,  message  priority  P  *  0,  distortion 
measure.  The  delay  in  milliseconds  is  shown  as  a  function  of  link 


distortion  D*  and  is  parameterized  for  three  message  rates  of  100, 
300,  and  500  msgs/sec.  As  noted  earlier,  by  allowing  message 
distortion,  transmission  above  the  classical  limit  is  possible,  and 
the  link  delay  will  remain  finite.  Of  course,  for  all  eases 

lim  T.  =  0 
1 

The  calculation  is  repeated  for  the  same  distortion  measure  and  the 
results  for  as  a  function  of  message  rate  X^  are  shown  in 
Figure  U.10.  T^ ,  in  milliseconds,  is  parameterized  for  D*  =  0.0, 
0.2,  and  0.6.  Figure  U.ll  and  Figure  U.12  display  as  a  function 
of  D*  and  X^  respectively,  for  the  binary  level  distortion  measure 
with  message  priority  P'  =  2.  Comparing  the  results  for  the  zero 
priority  and  priority  P  =  2  binary-level  measures  reveals  that 
either  under  equivalent  distortion  or  equivalent  message  rate,  the 
link  delay  is  slightly  greater  for  the  priority  P  =  2  measure.  This 
result  could  be  predicted  from  the  calculations  of  the  preceding 
section  and  highlights  the  expected  performance  tradeoff  between 
message  distortion  and  channel  delay. 

The  calculations  using  the  character  level  distortion 
measure,  with  priority  P  =  0  and  priority  P  «  2,  yield  the  curves 
of  Figures  U . 1 3  thru  U.l6. 

Again,  the  link  delay,  under  equivalent  distortion  or  . 
message  rate  conditions,  is  slightly  greater  for  the  priority 
P  =  2  measures.  In  addition,  the  delay  under  the  character  level 
distortion  measures  is  slightly  greater  than  the  delay,  under 


131 


equivalent  conditions,  of  the  binary  level  measures.  As  noted 
earlier,  these  contrasting  features  highlight  the  expected  tradeoff 
between  message  distortion  and  channel  delay. 

The  results  presented  in  this  section  may  be  concisely 
summarized: 

1.  Distortion  measures  with  message  priority  P  ~  2 
result  in  higher  channel  delays  than  measures  with 
priority  P  =  0. 

2.  The  binary  level  distortion  measure  results  in 
lower  channel  delay  than  the  comparable  character 
level  distortion  measure. 

In  the  next  section,  a  network  example  is  developed  to 
illustrate  (j,k)  path  level  rate  distortion  and  the  effect  on 
average  end-to-end  delay  and  average  network  message  delay. 

U . U  Network  Example 

In  this  section,  a  network  example  is  presented  to 
illustrate  the  implementation  of  the  path  level  relationships 
introduced  in  Chapter  2.  The  effect  of  the  path  level  relationships 
on  the  Min-Hop  routing  doctrine,  the  use  of  the  RDF  Decomposition 
Theorem,  and  a  new  upper  bound  on  end-to-end  delay  are  examined 
with  respect  to  the  network  example.  In  particular,  end-to-end 
delay  constraints  are  considered  as  functions  of  distortion  and  are 
upper-bounded,  and  the  average  network  message  delay  T  is 
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calculated.  The  results  are  displayed  as  a  locus  of  possible 
delay-distortion  pairs. 

The  network  used  in  Section  3-2.3  to  illustrate  the  Min-Hop 
algorithm  is  the  basis  for  the  example  of  this  section-  The  network 
is  reproduced  in  Figure  I*.  17,  where  the  underlined  values  are  the 
link  capacities  pCL  in  messages/sec.  The  assumed  traffic 
requirements  as  before,  are  Yab  =  Ycd  =  10,  Ybh  =  Yeb  »  Yfb  =  Ygf  = 
5,  and  y  =1,  each  in  messages/sec.  Similarly,  the  end-to-end 

C  3. 

average  delay  constraint  values  are  T&b  =  Tc(J  =  1.0  sec,  and 
are  taken  to  be  0.8  for  each  link,  except  link  fc  which  was  set  at 


0.9 

Fart  A  of  the  Min-Hop  algorithm  led  to  the  flow  assignment 

given  in  the  figure  by  the  first  number  in  parentheses  for  each 

link.  The  corresponding  routing  was 

y  ,  :  8  via  aedb  y  .  :  5  via  edhb 

ab  2  via  afdhb  eb 


y  10  via  cfd 
cd 

Ybh:  5  via  bdh 


y^:  5  via  fcgb 

ygf:  5  via  ghf 

Y  :  1  via  cfa 
ca 


in  messages/sec,  the  average  path  length  was  n  =  J  =  2.537,  and  the 
two  end-to-end  average  delays  were  T^b  *  1-lU  and  T^  =  1-33  sec. 

Following  the  problem  formulation  of  the  previous  section, 
it  is  assumed  that  each  source  in  the  network  can  choose  from  among 
256  equiprobable  messages.  For  the  purposes  of  the  example, it  is 
assumed  that  the  network  is  operating  under  the  binary  level 
distortion  measure  with  message  priority  P  ■  0  for  all  commodities. 
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e 


Figure  k.17  Network  example  for  centralized  Min-Hop  algorithm 
constrained  by  average  end-to-end  message  delay 


13b 


The  objective  of  the  first  calculation  is  to  express  the  end-to-end 
delay  for  the  (a,b)  traffic  as  a  function  of  the  path  level 
distortion,  i.e.  •  Tab  "  Tab  (D^)  where  is  distortion  for  the 
messages  originating  at  the  source  node  a  with  node  b  as  their 
destination.  It  is  assumed  further  that  a  network  optimization 
goal  is  to  minimize  message  corruption.  As  shown  in  Chapter  3, 
the  optimization  goal  can  be  achieved  when  routing  assignments  are 
made  according  to  the  Min-Hop  algorithm.  Therefore,  the  initial 
feasible  flow  that  obtains  from  the  Min-Hop  algorithm  is  assumed 
for  this  example.  Because  of  the  equiprobable  message  distribution 
at  source  node  and  the  symmetry  of  the  distortion  measure,  the 
output  messages  are  also  equiprobable  (as  shown  in  [1,3]).  Hence, 
the  link  level  distortion  measure  for  the  (a,b)  traffic  is  equal 
to  the  path  level  distortion  measure  if  the  (j,k)  traffic  on  path 
x  t  is  transmitted  with  the  same  distortion  as  the  (a,b)  traffic. 

Of  course,  this  sets  a  limit  to  the  minimum  distortion  possible 
for  the  (j,k)  traffic. 

The  result  of  the  calculation  is  shown  in  Figure  U.18. 
Tab(D&b)  is  equal  to  l.lU  seconds  when  the  messages  are  transmitted 
with  zero  distortion.  As  the  message  distortion  increases  T&b 
decreases.  By  allowing  a  cumulative  message  distortion 

=  0.02  the  end-to-end  delay  can  be  reduced  to  1.0  sec  which 
is  the  assumed  constraint  requirement  for  this  example.  Also 
shown  in  Figure  b.l8  is  an  upper  bound  for  the  end-to-end  delay 
Tab  calculated  as  a  function  of  distortion.  The  upper  bound 


was  found  by  bounding  each  of  the  alternate  routings.  Letting 
£ 

be  the  ith  link  delay  on  the  1th  alternate  routing  and  denoting 
the  number  of  links  on  the  1th  route  by  n^,  the  upper  bound  for 
the  end-to-end  delay  is  given  by 


'T*  =  l  ri(s,d)nt  max  (T*} 


(fc.7) 


,l  1 
1E7,sd 


where  s  is  the  source  node  and  d  is  the  destination  node,  and  the 
summation  is  over  all  the  1th  alternate  routings  and  the  ith  link:: 
each  path  lb  is  clearly  the  case  that  T™^x  >  for  all 


on 


ab 


ab 


distortions  Dat  in  the  range  (0,1);  it  is  also  clear  that  the 

calculation  of  T^x  is  always  significantly  easier  than  the 

calculation  of  T  ,  . 

ab 

Finally,  this  section  concludes  with  the  calculation  and 
presentation  of  the  average  network  message  delay  T(D)  as  a  function 
of  the  link  level  distortion 


,  M  A.Ri(Di ) 

T(D)  =  i-  l  - - - j-y 

Y  i=l  C,  -  X.R1(Di) 


(U.8) 


where 


for  all  links  and 


D1  =  D 


Y  ■  l  Y 


This  is  the  sort  of  message  delay  that  can  be  obtained  if  all  links 
are  allowed  distortion  D.  The  consequences  for  the  end-to-end 
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message  distortion  would  depend  on  the  role  of  the  switching 
computers.  If  the  switching  computers  did  not  participate  in  error 
detect/correct  processing,  the  message  distortion  would,  in  general, 
accumulate.  The  exception  of  course,  is  in  the  case  of  equi probable 
input  message  distributions  and  a  symmetrical  distortion  measure, 
as  in  this  example.  If  the  switching  computers  do  participate  in 
error  detect /correct  processing,  the  message  distortion  would  not 
accumulate  as  the  messages  move  through  the  network,  but  there  could 
be  significant  delays  due  to  the  additional  processing.  The  average 
message  delay  for  this  network  example  is  presented  in  Figure  U.19. 
The  average  delay  for  messages  with  zero  distortion  is  0.86l  seconds. 
As  expected,  in  the  limit  of  total  message  corruption  the  average 
delay  goes  to  zero. 

In  the  next  and  last  section,  the  chapter  concludes  with  a 
comparison  of  the  best  and  worst  case  results  for  message  delay  as  a 
function  of  message  distortion. 

4 . 5  Conclusion 

In  an  earlier  section,  message  delay  was  calculated  for  a 
number  of  distortion  measures.  In  Figure  U.20,  the  best  case  (least 
delay)  and  worst  case  (most  delay)  results  are  compared.  The  best 
case  result  was  obtained  under  the  binary  level  distortion  measure 
with  message  priority  P  *  0.  The  worst  case  result  was  obtained 
under  the  character  level  distortion  measure  with  message  priority 
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-  Binary  level  distortion  with  P  *  0 

-  Character  level  distortion  with  P  =  2 

-  100  msgs/sec 


Figure  k.20  Link  delay  compared  for  normalized  binary  and 
character  level  distortions  with  P  =  0  and  P  *  2 
respectively 


Uo 

P  =  2.  As  can  toe  seen  from  Figure  U.20,  the  difference  in  delay 
for  the  two  results  varies  greatly  as  the  distortion  ranges  from 
0  to  1.  Again,  the  implication  is  that  message  delay  can  toe 
reduced  toy  allowing  message  corruption. 

In  this  chapter,  results  from  Chapters  2  and  3  were  applied 
to  a  network  example.  The  example  provided  a  demonstration  of  the 
thesis  that  message  delay  can  toe  reduced  by  allowing  message 
distortion,  thereby  increasing  the  effective  network  channel 
capacity . 
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Chapter  5 


CONCLUSIONS  AND  SUGGESTIONS  FOR  FUTURE  RESEARCH 

5 . 1  Conclusions 

The  objective  of  this  research  has  been  to  provide  a 
theoretical  model  for  dealing  with  the  problem  of  message  corruption 
in  large-scale,  data-communi cation  networks.  The  message  corruption 
can  be  due  to  link  noise,  finite  nodal  buffers,  and  protocol 
dependent  errors.  Information-theoretic  and  queueing- theoretic 
methodologies  have  been  used  in  the  articulation  and  analysis  of  the 
theoretical  model  with  several  network  examples  serving  to  illus¬ 
trate  specific  implementation  schemes  and  provide  computational 
results . 

In  Chapter  1,  a  brief  overview  was  presented  along  with  the 
stochastic  'network  of  queues'  model.  Chapter  2  contained  the  basic 
information-theoretic  concepts  relating  to  rate  distortion  theory 
and  their  application  to  data-communication  networks.  Chapter  3 
introduced  and  analyzed  several  new  routing  doctrines  whose 
assignment  policies  optimized  message  fidelity.  Chapter  3  also 
provided  several  network  examples  to  illustrate  the  Min-Hop  routing 
algorithm  in  both  its  centralized  and  decentralized  forms,  with  and 
without  message  delay  constraints.  In  Chapter  b,  the  rate 
distortion  theory  of  Chapter  2  and  the  Min-Hop  algorithm  of 
Chapter  3  provided  the  basis  fo  •  computational  results  demonstrating 


The  effects  of  the  various  distortion  measures  and  their  application 
to  network  traffic. 

The  fundamental  conclusions  of  this  research  are: 

1.  Rate  distortion  theory  can  be  extended  and  enhanced  to 
provide  a  technique  for  network  performance  analysis  in  the  event 
that  message  errors  are  an  important  consideration. 

2.  Message  delay  may  be  formulated  as  a  function  of 
message  corruption,  in  addition  to  the  traditional  variables  of 
message  length,  link  flow,  and  link  capacity. 

3.  The  Min-Hop  routing  policy  optimized  network  performance 
in  the  noisy  message  environment  and  can  be  implemented  in  a 
centralized  or  distributed  fashion,  with  and  without  message  delay 
constraints . 

There  are,  of  course,  philosophical  questions  regarding  the 
utility  of  a  system  implementation.  The  cost  of  successive  source 
encodings  as  a  message  is  passed  over  a  series  of  links  may  offset 
the  decrease  in  message  delay  and  is  certainly  a  tradeoff  to  be  considere 

5.2  Future  Research 

There  are  a  number  of  interesting  questions  raised  by  these 
investigations  which  could  serve  as  a  motivation  for  future  research. 

In  the  domain  of  the  network  level  rate  distortion  theory,  the  effect 
and  construction  of  additional  distortion  measures  should  be  considered, 
e.g.  distortion  metrics  which  are  functions  of  message  context.  In  a 
similar  fashion,  a  small  scale  network  in  which  message  rate  and  message 
distortion  can  be  controlled  would  provide  an  invaluable  tool  for 


validation  of  theoretical  results.  An  associated  problem  is  the 
relation  of  these  investigations,  especially  the  network  message  delay 
results,  to  bit  oriented  and  character  oriented  protocols.  And,  of 
course,  there  is  need  to  develop  an  optimum  distributed  Min-Hop  algorithm 
which  is  also  viable  from  an  implementation  perspective.  Finally,  as 
an  improvement  to  the  'network  of  queues'  model  would  be  the  use  of 
the  Pollaczek-Khinchin  formula  for  average  waiting  time  in  an  M/G/l 
system  and  the  network  level  rate  distortion  theory  to  develop  a 
M/G/l-RDF  network  theory. 
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